Skip to content

perf[array]: bool filter kernel optimisation#7125

Merged
robert3005 merged 10 commits into
developfrom
ji/bool-filter-optimized
May 22, 2026
Merged

perf[array]: bool filter kernel optimisation#7125
robert3005 merged 10 commits into
developfrom
ji/bool-filter-optimized

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Mar 23, 2026 •
edited by robert3005
Loading

Iterate bit buffers instead of indices or slices when filtering boolean arrays

@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Mar 23, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Mar 23, 2026 •
edited
Loading

Merging this PR will improve performance by ×6.1

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 74 improved benchmarks
❌ 1 regressed benchmark
✅ 1176 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 187.9 µs 225.3 µs -16.6%
⚡ Simulation density_sweep_dense_runs[0.001] 578.7 µs 44.5 µs ×13
⚡ Simulation density_sweep_dense_runs[0.005] 578.4 µs 44.5 µs ×13
⚡ Simulation density_sweep_dense_runs[0.01] 578.4 µs 44.5 µs ×13
⚡ Simulation density_sweep_dense_runs[0.02] 578.6 µs 44.5 µs ×13
⚡ Simulation density_sweep_dense_runs[0.05] 579.2 µs 44.5 µs ×13
⚡ Simulation density_sweep_dense_runs[0.1] 582 µs 44.6 µs ×13
⚡ Simulation density_sweep_dense_runs[0.5] 713.3 µs 45.6 µs ×16
⚡ Simulation density_sweep_dense_runs[0.95] 1,539.9 µs 49.6 µs ×31
⚡ Simulation density_sweep_dense_runs[0.9999] 229.1 µs 45.7 µs ×5
⚡ Simulation density_sweep_dense_runs[0.999] 235.6 µs 46 µs ×5.1
⚡ Simulation density_sweep_dense_runs[0.99] 457.2 µs 47.8 µs ×9.6
⚡ Simulation density_sweep_dense_runs[0.9] 2,716.8 µs 49.1 µs ×55
⚡ Simulation density_sweep_random[0.01] 50.7 µs 45.5 µs +11.31%
⚡ Simulation density_sweep_random[0.02] 65.1 µs 57.1 µs +14.05%
⚡ Simulation density_sweep_random[0.05] 106.1 µs 86.8 µs +22.32%
⚡ Simulation density_sweep_random[0.1] 174.1 µs 41.5 µs ×4.2
⚡ Simulation density_sweep_random[0.5] 708.1 µs 45.5 µs ×16
⚡ Simulation density_sweep_random[0.95] 1,449.1 µs 49.9 µs ×29
⚡ Simulation density_sweep_random[0.9999] 219.2 µs 45.8 µs ×4.8
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ji/bool-filter-optimized (afac7dd) with develop (251e603)

Open in CodSpeed

Base automatically changed from ji/bool-filter-bench to develop March 24, 2026 11:40
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

This PR has been marked as stale because it has been open for 30 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Apr 15, 2026
@joseph-isaacs joseph-isaacs removed the stale This PR is stale and will be auto-closed soon label Apr 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label May 18, 2026
@robert3005 robert3005 force-pushed the ji/bool-filter-optimized branch from 23cdf5f to 1522ebb Compare May 21, 2026 12:11
@robert3005 robert3005 marked this pull request as ready for review May 21, 2026 12:15
@robert3005 robert3005 removed the stale This PR is stale and will be auto-closed soon label May 21, 2026
@robert3005 robert3005 force-pushed the ji/bool-filter-optimized branch from 7b91127 to 8887220 Compare May 21, 2026 12:16
joseph-isaacs
joseph-isaacs commented May 22, 2026
View reviewed changes
Comment thread vortex-array/src/arrays/filter/execute/primitive.rs Outdated
joseph-isaacs
joseph-isaacs commented May 22, 2026
View reviewed changes
Comment thread vortex-array/src/arrays/filter/execute/primitive.rs Outdated
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 22, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 22, 2026
joseph-isaacs
joseph-isaacs commented May 22, 2026
View reviewed changes
Copy link
Copy Markdown
Contributor Author

@joseph-isaacs joseph-isaacs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I cannot approve but I do approve this

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a8ddbfe 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done a8ddbfe 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.048x ➖

datafusion / vortex-file-compressed (1.048x ➖, 0↑ 2↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 120483771 108030886 1.12
polarsignals_q01/datafusion:vortex-file-compressed 268009187 282755578 0.95
polarsignals_q02/datafusion:vortex-file-compressed 23245214 22808279 1.02
polarsignals_q03/datafusion:vortex-file-compressed 297652132 277498655 1.07
polarsignals_q04/datafusion:vortex-file-compressed 11528798 10735414 1.07
polarsignals_q05/datafusion:vortex-file-compressed 🚨 15501556 14027471 1.11
polarsignals_q06/datafusion:vortex-file-compressed 18030562 17450411 1.03
polarsignals_q07/datafusion:vortex-file-compressed 13721630 12478715 1.10
polarsignals_q08/datafusion:vortex-file-compressed 411446818 409202250 1.01
polarsignals_q09/datafusion:vortex-file-compressed 10645799 10435819 1.02

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.41 MB 689.41 MB 32 B -0.0%

Totals:

  • vortex-file-compressed: 689.41 MB → 689.41 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 1.024x ➖
Parquet (geomean): 1.040x ➖
Shifts: Parquet (control) +4.0% · Median polish +1.0%

datafusion / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4973013 5131657 0.97
fineweb_q01/datafusion:vortex-file-compressed 21851114 21667868 1.01
fineweb_q02/datafusion:vortex-file-compressed 22436531 22195149 1.01
fineweb_q03/datafusion:vortex-file-compressed 81261349 82674717 0.98
fineweb_q04/datafusion:vortex-file-compressed 227445357 226468224 1.00
fineweb_q05/datafusion:vortex-file-compressed 223689703 217735224 1.03
fineweb_q06/datafusion:vortex-file-compressed 51420377 50391861 1.02
fineweb_q07/datafusion:vortex-file-compressed 59178190 54390013 1.09
fineweb_q08/datafusion:vortex-file-compressed 22176635 22050320 1.01
datafusion / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5795977 5605201 1.03
fineweb_q01/datafusion:vortex-compact 91981557 94028966 0.98
fineweb_q02/datafusion:vortex-compact 106013463 99034906 1.07
fineweb_q03/datafusion:vortex-compact 844524251 872390996 0.97
fineweb_q04/datafusion:vortex-compact 909510582 903726242 1.01
fineweb_q05/datafusion:vortex-compact 819203407 830574489 0.99
fineweb_q06/datafusion:vortex-compact 468879320 468092115 1.00
fineweb_q07/datafusion:vortex-compact 464812015 480839027 0.97
fineweb_q08/datafusion:vortex-compact 17989718 18801652 0.96
datafusion / parquet (0.996x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6692110 6971457 0.96
fineweb_q01/datafusion:parquet 288600803 295940808 0.98
fineweb_q02/datafusion:parquet 287491551 296229728 0.97
fineweb_q03/datafusion:parquet 299031395 280959976 1.06
fineweb_q04/datafusion:parquet 300915477 295153290 1.02
fineweb_q05/datafusion:parquet 299273669 300591177 1.00
fineweb_q06/datafusion:parquet 289945621 298614219 0.97
fineweb_q07/datafusion:parquet 290765846 286768799 1.01
fineweb_q08/datafusion:parquet 284894615 284592644 1.00
duckdb / vortex-file-compressed (1.077x ➖, 0↑ 3↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 4146378 3958513 1.05
fineweb_q01/duckdb:vortex-file-compressed 🚨 28718332 24274035 1.18
fineweb_q02/duckdb:vortex-file-compressed 🚨 28624489 24145702 1.19
fineweb_q03/duckdb:vortex-file-compressed 169610174 163502456 1.04
fineweb_q04/duckdb:vortex-file-compressed 🚨 240957656 217091197 1.11
fineweb_q05/duckdb:vortex-file-compressed 214970246 210385247 1.02
fineweb_q06/duckdb:vortex-file-compressed 55145625 52402855 1.05
fineweb_q07/duckdb:vortex-file-compressed 53028557 54182204 0.98
fineweb_q08/duckdb:vortex-file-compressed 24072366 22036525 1.09
duckdb / vortex-compact (1.012x ➖, 0↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4127157 4241891 0.97
fineweb_q01/duckdb:vortex-compact 111948380 105779059 1.06
fineweb_q02/duckdb:vortex-compact 121124954 117439572 1.03
fineweb_q03/duckdb:vortex-compact 851317555 846862173 1.01
fineweb_q04/duckdb:vortex-compact 🚨 1009481076 893537014 1.13
fineweb_q05/duckdb:vortex-compact 809329059 801131000 1.01
fineweb_q06/duckdb:vortex-compact 462127023 462181952 1.00
fineweb_q07/duckdb:vortex-compact 475065345 476561009 1.00
fineweb_q08/duckdb:vortex-compact 18374627 20069106 0.92
duckdb / parquet (1.087x ➖, 0↑ 4↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30430385 30984513 0.98
fineweb_q01/duckdb:parquet 84705641 84474022 1.00
fineweb_q02/duckdb:parquet 84979149 84844837 1.00
fineweb_q03/duckdb:parquet 336867030 317236697 1.06
fineweb_q04/duckdb:parquet 486512152 447511558 1.09
fineweb_q05/duckdb:parquet 🚨 467718115 415524313 1.13
fineweb_q06/duckdb:parquet 🚨 234184522 205026945 1.14
fineweb_q07/duckdb:parquet 🚨 247026152 215580042 1.15
fineweb_q08/duckdb:parquet 🚨 41363248 32866893 1.26
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +3.4% -2.9% +6.5% +45.8% ➖ noise
0 datafusion:vortex-file-compressed -3.1% -2.9% -0.2% +47.7% ➖ noise
0 duckdb:vortex-compact -2.7% -2.9% +0.2% +87.9% ➖ noise
0 duckdb:vortex-file-compressed +4.7% -2.9% +7.9% +74.4% ➖ noise
1 datafusion:vortex-compact -2.2% -1.1% -1.1% +13.1% ➖ noise
1 datafusion:vortex-file-compressed +0.8% -1.1% +2.0% +28.5% ➖ noise
1 duckdb:vortex-compact +5.8% -1.1% +7.0% +20.4% ➖ noise
1 duckdb:vortex-file-compressed +18.3% -1.1% +19.6% +54.7% ➖ noise
2 datafusion:vortex-compact +7.0% -1.4% +8.6% +16.9% ➖ noise
2 datafusion:vortex-file-compressed +1.1% -1.4% +2.5% +13.1% ➖ noise
2 duckdb:vortex-compact +3.1% -1.4% +4.6% +14.1% ➖ noise
2 duckdb:vortex-file-compressed +18.5% -1.4% +20.2% +13.7% 🚨 regression
3 datafusion:vortex-compact -3.2% +6.3% -8.9% +13.1% ➖ noise
3 datafusion:vortex-file-compressed -1.7% +6.3% -7.5% +32.4% ➖ noise
3 duckdb:vortex-compact +0.5% +6.3% -5.4% +13.1% ➖ noise
3 duckdb:vortex-file-compressed +3.7% +6.3% -2.4% +31.9% ➖ noise
4 datafusion:vortex-compact +0.6% +5.3% -4.4% +13.1% ➖ noise
4 datafusion:vortex-file-compressed +0.4% +5.3% -4.6% +13.1% ➖ noise
4 duckdb:vortex-compact +13.0% +5.3% +7.3% +13.1% ➖ noise
4 duckdb:vortex-file-compressed +11.0% +5.3% +5.4% +13.1% ➖ noise
5 datafusion:vortex-compact -1.4% +5.9% -6.8% +13.1% ➖ noise
5 datafusion:vortex-file-compressed +2.7% +5.9% -3.0% +13.1% ➖ noise
5 duckdb:vortex-compact +1.0% +5.9% -4.6% +13.1% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +5.9% -3.5% +13.1% ➖ noise
6 datafusion:vortex-compact +0.2% +5.3% -4.9% +13.1% ➖ noise
6 datafusion:vortex-file-compressed +2.0% +5.3% -3.1% +13.1% ➖ noise
6 duckdb:vortex-compact -0.0% +5.3% -5.1% +13.1% ➖ noise
6 duckdb:vortex-file-compressed +5.2% +5.3% -0.1% +13.1% ➖ noise
7 datafusion:vortex-compact -3.3% +7.8% -10.3% +13.1% ➖ noise
7 datafusion:vortex-file-compressed +8.8% +7.8% +0.9% +19.9% ➖ noise
7 duckdb:vortex-compact -0.3% +7.8% -7.5% +13.1% ➖ noise
7 duckdb:vortex-file-compressed -2.1% +7.8% -9.2% +17.7% ➖ noise
8 datafusion:vortex-compact -4.3% +12.2% -14.8% +17.5% ➖ noise
8 datafusion:vortex-file-compressed +0.6% +12.2% -10.4% +13.1% ➖ noise
8 duckdb:vortex-compact -8.4% +12.2% -18.4% +13.1% ✅ faster
8 duckdb:vortex-file-compressed +9.2% +12.2% -2.7% +13.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB 32 B -0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 32 B -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.952x ➖
Parquet (geomean): 0.945x ➖
Shifts: Parquet (control) -5.5% · Median polish -8.0%

datafusion / vortex-file-compressed (0.946x ➖, 11↑ 2↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 49784149 57904769 0.86
tpch_q02/datafusion:vortex-file-compressed 23204044 25301967 0.92
tpch_q03/datafusion:vortex-file-compressed 🚀 28555810 32076991 0.89
tpch_q04/datafusion:vortex-file-compressed 🚀 20363190 23066698 0.88
tpch_q05/datafusion:vortex-file-compressed 🚀 48084301 55731365 0.86
tpch_q06/datafusion:vortex-file-compressed 🚀 10598199 11943707 0.89
tpch_q07/datafusion:vortex-file-compressed 🚀 54413266 64001780 0.85
tpch_q08/datafusion:vortex-file-compressed 🚀 40525406 45648049 0.89
tpch_q09/datafusion:vortex-file-compressed 🚀 51914803 61694850 0.84
tpch_q10/datafusion:vortex-file-compressed 🚀 40924609 45900644 0.89
tpch_q11/datafusion:vortex-file-compressed 17273682 17560250 0.98
tpch_q12/datafusion:vortex-file-compressed 29791483 27458923 1.08
tpch_q13/datafusion:vortex-file-compressed 🚀 24932347 27841679 0.90
tpch_q14/datafusion:vortex-file-compressed 16369398 17600699 0.93
tpch_q15/datafusion:vortex-file-compressed 25223230 27275545 0.92
tpch_q16/datafusion:vortex-file-compressed 🚀 20030220 22719264 0.88
tpch_q17/datafusion:vortex-file-compressed 79970178 79163894 1.01
tpch_q18/datafusion:vortex-file-compressed 106192319 96827910 1.10
tpch_q19/datafusion:vortex-file-compressed 23102712 22224523 1.04
tpch_q20/datafusion:vortex-file-compressed 🚨 36095885 31994849 1.13
tpch_q21/datafusion:vortex-file-compressed 🚨 93474544 82345831 1.14
tpch_q22/datafusion:vortex-file-compressed 14236590 14000173 1.02
datafusion / vortex-compact (1.018x ➖, 4↑ 6↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 71782918 63851884 1.12
tpch_q02/datafusion:vortex-compact 30871133 28463797 1.08
tpch_q03/datafusion:vortex-compact 35143631 32963886 1.07
tpch_q04/datafusion:vortex-compact 🚨 27359716 24382238 1.12
tpch_q05/datafusion:vortex-compact 🚨 65340852 57952972 1.13
tpch_q06/datafusion:vortex-compact 🚨 15037514 13614073 1.10
tpch_q07/datafusion:vortex-compact 🚨 74806651 67712445 1.10
tpch_q08/datafusion:vortex-compact 52429870 48974451 1.07
tpch_q09/datafusion:vortex-compact 70878591 66923430 1.06
tpch_q10/datafusion:vortex-compact 🚨 57339310 50069021 1.15
tpch_q11/datafusion:vortex-compact 20069361 18782994 1.07
tpch_q12/datafusion:vortex-compact 37094435 34077131 1.09
tpch_q13/datafusion:vortex-compact 37344731 34502124 1.08
tpch_q14/datafusion:vortex-compact 22444770 20652355 1.09
tpch_q15/datafusion:vortex-compact 32899556 35084470 0.94
tpch_q16/datafusion:vortex-compact 24768335 27189333 0.91
tpch_q17/datafusion:vortex-compact 🚀 70722493 80084742 0.88
tpch_q18/datafusion:vortex-compact 🚀 85499738 99851936 0.86
tpch_q19/datafusion:vortex-compact 30266790 32025633 0.95
tpch_q20/datafusion:vortex-compact 34529259 38219549 0.90
tpch_q21/datafusion:vortex-compact 🚀 76183929 87364225 0.87
tpch_q22/datafusion:vortex-compact 🚀 12396964 14262280 0.87
datafusion / parquet (0.926x ➖, 8↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 139443074 111567458 1.25
tpch_q02/datafusion:parquet 🚀 60131729 67063694 0.90
tpch_q03/datafusion:parquet 69937295 77417755 0.90
tpch_q04/datafusion:parquet 43481779 46421167 0.94
tpch_q05/datafusion:parquet 92067489 101059013 0.91
tpch_q06/datafusion:parquet 🚀 38663710 45288096 0.85
tpch_q07/datafusion:parquet 105729333 117280811 0.90
tpch_q08/datafusion:parquet 88503816 95394415 0.93
tpch_q09/datafusion:parquet 128858149 140634429 0.92
tpch_q10/datafusion:parquet 111020751 123237829 0.90
tpch_q11/datafusion:parquet 🚀 40966800 45688780 0.90
tpch_q12/datafusion:parquet 87083527 90481150 0.96
tpch_q13/datafusion:parquet 🚀 200036465 229986936 0.87
tpch_q14/datafusion:parquet 43868348 43606707 1.01
tpch_q15/datafusion:parquet 62125046 65350669 0.95
tpch_q16/datafusion:parquet 🚀 39795744 46576026 0.85
tpch_q17/datafusion:parquet 🚀 125474907 148156262 0.85
tpch_q18/datafusion:parquet 🚀 165225739 183734210 0.90
tpch_q19/datafusion:parquet 81705094 81960429 1.00
tpch_q20/datafusion:parquet 🚀 68349551 76167006 0.90
tpch_q21/datafusion:parquet 138554219 146183649 0.95
tpch_q22/datafusion:parquet 31508976 34382272 0.92
datafusion / arrow (0.860x ✅, 18↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 56029721 62731220 0.89
tpch_q02/datafusion:arrow 🚀 18910061 21071922 0.90
tpch_q03/datafusion:arrow 🚀 29302158 37548802 0.78
tpch_q04/datafusion:arrow 🚀 25409689 32138030 0.79
tpch_q05/datafusion:arrow 83976318 85754449 0.98
tpch_q06/datafusion:arrow 21535540 23476305 0.92
tpch_q07/datafusion:arrow 🚀 101911387 117314101 0.87
tpch_q08/datafusion:arrow 🚀 42535913 51916140 0.82
tpch_q09/datafusion:arrow 🚀 64374594 77595979 0.83
tpch_q10/datafusion:arrow 🚀 45954194 55568614 0.83
tpch_q11/datafusion:arrow 🚀 9239618 10316061 0.90
tpch_q12/datafusion:arrow 🚀 51386512 59412084 0.86
tpch_q13/datafusion:arrow 47386627 49532058 0.96
tpch_q14/datafusion:arrow 🚀 21548881 25790353 0.84
tpch_q15/datafusion:arrow 🚀 42840799 51095165 0.84
tpch_q16/datafusion:arrow 🚀 18870337 21325817 0.88
tpch_q17/datafusion:arrow 🚀 67419664 80237573 0.84
tpch_q18/datafusion:arrow 🚀 135354615 157384215 0.86
tpch_q19/datafusion:arrow 🚀 33783546 43121480 0.78
tpch_q20/datafusion:arrow 🚀 33620049 40992564 0.82
tpch_q21/datafusion:arrow 🚀 144402560 171899895 0.84
tpch_q22/datafusion:arrow 18146940 19452730 0.93
duckdb / vortex-file-compressed (0.902x ➖, 10↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31995061 33522337 0.95
tpch_q02/duckdb:vortex-file-compressed 🚀 24884946 28493303 0.87
tpch_q03/duckdb:vortex-file-compressed 33197342 35685017 0.93
tpch_q04/duckdb:vortex-file-compressed 28978818 31533520 0.92
tpch_q05/duckdb:vortex-file-compressed 🚀 37576552 42520207 0.88
tpch_q06/duckdb:vortex-file-compressed 🚀 8626919 10223385 0.84
tpch_q07/duckdb:vortex-file-compressed 🚀 35253462 39932220 0.88
tpch_q08/duckdb:vortex-file-compressed 37317754 40212714 0.93
tpch_q09/duckdb:vortex-file-compressed 58206171 63655108 0.91
tpch_q10/duckdb:vortex-file-compressed 🚀 40988074 45670422 0.90
tpch_q11/duckdb:vortex-file-compressed 15466622 15802704 0.98
tpch_q12/duckdb:vortex-file-compressed 22302868 24471766 0.91
tpch_q13/duckdb:vortex-file-compressed 37960840 42053378 0.90
tpch_q14/duckdb:vortex-file-compressed 🚀 22077873 24751980 0.89
tpch_q15/duckdb:vortex-file-compressed 17166335 18894801 0.91
tpch_q16/duckdb:vortex-file-compressed 29841989 30775256 0.97
tpch_q17/duckdb:vortex-file-compressed 🚀 23999899 27608426 0.87
tpch_q18/duckdb:vortex-file-compressed 52797685 57830393 0.91
tpch_q19/duckdb:vortex-file-compressed 🚀 28967073 34275280 0.85
tpch_q20/duckdb:vortex-file-compressed 33161131 36642540 0.90
tpch_q21/duckdb:vortex-file-compressed 🚀 99391659 116941981 0.85
tpch_q22/duckdb:vortex-file-compressed 🚀 17160931 19226317 0.89
duckdb / vortex-compact (0.945x ➖, 4↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38529513 40315473 0.96
tpch_q02/duckdb:vortex-compact 🚀 31668764 35540371 0.89
tpch_q03/duckdb:vortex-compact 35254758 39053112 0.90
tpch_q04/duckdb:vortex-compact 31498388 33817414 0.93
tpch_q05/duckdb:vortex-compact 🚀 40838002 46309295 0.88
tpch_q06/duckdb:vortex-compact 10774956 11690808 0.92
tpch_q07/duckdb:vortex-compact 🚀 40446513 45429488 0.89
tpch_q08/duckdb:vortex-compact 42042155 44798156 0.94
tpch_q09/duckdb:vortex-compact 66275638 70951645 0.93
tpch_q10/duckdb:vortex-compact 45460761 50312536 0.90
tpch_q11/duckdb:vortex-compact 18498017 20173194 0.92
tpch_q12/duckdb:vortex-compact 29753987 32142902 0.93
tpch_q13/duckdb:vortex-compact 45711785 47647317 0.96
tpch_q14/duckdb:vortex-compact 🚀 26800473 29801129 0.90
tpch_q15/duckdb:vortex-compact 20723022 22457434 0.92
tpch_q16/duckdb:vortex-compact 33352444 35766846 0.93
tpch_q17/duckdb:vortex-compact 32519805 32453350 1.00
tpch_q18/duckdb:vortex-compact 59057804 57066377 1.03
tpch_q19/duckdb:vortex-compact 39310298 37827985 1.04
tpch_q20/duckdb:vortex-compact 45861377 44463229 1.03
tpch_q21/duckdb:vortex-compact 122273746 117624111 1.04
tpch_q22/duckdb:vortex-compact 20651391 21197787 0.97
duckdb / parquet (0.965x ➖, 3↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79557093 77263628 1.03
tpch_q02/duckdb:parquet 39245093 41851050 0.94
tpch_q03/duckdb:parquet 70762486 74604278 0.95
tpch_q04/duckdb:parquet 51529583 52713816 0.98
tpch_q05/duckdb:parquet 71976555 71182640 1.01
tpch_q06/duckdb:parquet 23835941 23214135 1.03
tpch_q07/duckdb:parquet 78143901 74737668 1.05
tpch_q08/duckdb:parquet 88190549 86223978 1.02
tpch_q09/duckdb:parquet 158063178 146800660 1.08
tpch_q10/duckdb:parquet 134805795 134668325 1.00
tpch_q11/duckdb:parquet 23407086 23764456 0.98
tpch_q12/duckdb:parquet 🚀 47785486 57131735 0.84
tpch_q13/duckdb:parquet 🚀 254149829 285576917 0.89
tpch_q14/duckdb:parquet 51146629 53998123 0.95
tpch_q15/duckdb:parquet 27148392 26966471 1.01
tpch_q16/duckdb:parquet 58404586 63201230 0.92
tpch_q17/duckdb:parquet 58476511 63010979 0.93
tpch_q18/duckdb:parquet 118135383 126492489 0.93
tpch_q19/duckdb:parquet 🚀 68803362 77413017 0.89
tpch_q20/duckdb:parquet 65457939 67307782 0.97
tpch_q21/duckdb:parquet 173555591 183306572 0.95
tpch_q22/duckdb:parquet 52766940 56713559 0.93
duckdb / duckdb (0.934x ➖, 3↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17732050 18391318 0.96
tpch_q02/duckdb:duckdb 15010331 15856641 0.95
tpch_q03/duckdb:duckdb 🚀 22726047 25631817 0.89
tpch_q04/duckdb:duckdb 21151288 23140116 0.91
tpch_q05/duckdb:duckdb 23816812 24650779 0.97
tpch_q06/duckdb:duckdb 7001456 7524747 0.93
tpch_q07/duckdb:duckdb 🚀 25457533 28479419 0.89
tpch_q08/duckdb:duckdb 24602126 25598570 0.96
tpch_q09/duckdb:duckdb 🚀 58815677 65895039 0.89
tpch_q10/duckdb:duckdb 52751461 55291713 0.95
tpch_q11/duckdb:duckdb 7408838 8019945 0.92
tpch_q12/duckdb:duckdb 17992221 18920415 0.95
tpch_q13/duckdb:duckdb 40183241 42394710 0.95
tpch_q14/duckdb:duckdb 21588002 23708594 0.91
tpch_q15/duckdb:duckdb 13663331 14320514 0.95
tpch_q16/duckdb:duckdb 26402282 28300084 0.93
tpch_q17/duckdb:duckdb 16037795 17279483 0.93
tpch_q18/duckdb:duckdb 40763787 42612520 0.96
tpch_q19/duckdb:duckdb 30512950 33777302 0.90
tpch_q20/duckdb:duckdb 25158442 26408438 0.95
tpch_q21/duckdb:duckdb 62625724 68204085 0.92
tpch_q22/duckdb:duckdb 25592459 26312549 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -10.7% +13.4% -21.3% +21.1% ✅ faster
1 datafusion:vortex-compact +12.4% +13.4% -0.9% +18.7% ➖ noise
1 datafusion:vortex-file-compressed -14.0% +13.4% -24.2% +18.8% ✅ faster
1 duckdb:duckdb -3.6% +13.4% -15.0% +17.4% ✅ faster
1 duckdb:vortex-compact -4.4% +13.4% -15.8% +17.5% ✅ faster
1 duckdb:vortex-file-compressed -4.6% +13.4% -15.9% +20.0% ➖ noise
2 datafusion:arrow -10.3% -8.3% -2.1% +14.6% ➖ noise
2 datafusion:vortex-compact +8.5% -8.3% +18.3% +14.6% 🚨 regression
2 datafusion:vortex-file-compressed -8.3% -8.3% +0.0% +14.6% ➖ noise
2 duckdb:duckdb -5.3% -8.3% +3.2% +14.6% ➖ noise
2 duckdb:vortex-compact -10.9% -8.3% -2.8% +14.6% ➖ noise
2 duckdb:vortex-file-compressed -12.7% -8.3% -4.8% +14.6% ➖ noise
3 datafusion:arrow -22.0% -7.4% -15.7% +14.6% ✅ faster
3 datafusion:vortex-compact +6.6% -7.4% +15.2% +14.6% 🚨 regression
3 datafusion:vortex-file-compressed -11.0% -7.4% -3.8% +14.6% ➖ noise
3 duckdb:duckdb -11.3% -7.4% -4.2% +14.6% ➖ noise
3 duckdb:vortex-compact -9.7% -7.4% -2.5% +14.6% ➖ noise
3 duckdb:vortex-file-compressed -7.0% -7.4% +0.5% +14.6% ➖ noise
4 datafusion:arrow -20.9% -4.3% -17.4% +14.6% ✅ faster
4 datafusion:vortex-compact +12.2% -4.3% +17.3% +14.6% 🚨 regression
4 datafusion:vortex-file-compressed -11.7% -4.3% -7.7% +14.6% ➖ noise
4 duckdb:duckdb -8.6% -4.3% -4.5% +14.6% ➖ noise
4 duckdb:vortex-compact -6.9% -4.3% -2.7% +14.6% ➖ noise
4 duckdb:vortex-file-compressed -8.1% -4.3% -4.0% +14.6% ➖ noise
5 datafusion:arrow -2.1% -4.0% +2.0% +14.6% ➖ noise
5 datafusion:vortex-compact +12.7% -4.0% +17.5% +14.6% 🚨 regression
5 datafusion:vortex-file-compressed -13.7% -4.0% -10.1% +14.6% ➖ noise
5 duckdb:duckdb -3.4% -4.0% +0.7% +14.6% ➖ noise
5 duckdb:vortex-compact -11.8% -4.0% -8.1% +14.6% ➖ noise
5 duckdb:vortex-file-compressed -11.6% -4.0% -7.9% +14.6% ➖ noise
6 datafusion:arrow -8.3% -6.4% -2.0% +14.6% ➖ noise
6 datafusion:vortex-compact +10.5% -6.4% +18.0% +15.5% 🚨 regression
6 datafusion:vortex-file-compressed -11.3% -6.4% -5.2% +14.6% ➖ noise
6 duckdb:duckdb -7.0% -6.4% -0.6% +14.6% ➖ noise
6 duckdb:vortex-compact -7.8% -6.4% -1.6% +16.9% ➖ noise
6 duckdb:vortex-file-compressed -15.6% -6.4% -9.9% +17.3% ➖ noise
7 datafusion:arrow -13.1% -2.9% -10.5% +14.6% ➖ noise
7 datafusion:vortex-compact +10.5% -2.9% +13.8% +14.6% ➖ noise
7 datafusion:vortex-file-compressed -15.0% -2.9% -12.4% +14.6% ➖ noise
7 duckdb:duckdb -10.6% -2.9% -7.9% +14.6% ➖ noise
7 duckdb:vortex-compact -11.0% -2.9% -8.3% +14.6% ➖ noise
7 duckdb:vortex-file-compressed -11.7% -2.9% -9.1% +14.6% ➖ noise
8 datafusion:arrow -18.1% -2.6% -15.9% +14.6% ✅ faster
8 datafusion:vortex-compact +7.1% -2.6% +9.9% +14.6% ➖ noise
8 datafusion:vortex-file-compressed -11.2% -2.6% -8.9% +14.6% ➖ noise
8 duckdb:duckdb -3.9% -2.6% -1.3% +14.6% ➖ noise
8 duckdb:vortex-compact -6.2% -2.6% -3.7% +14.6% ➖ noise
8 duckdb:vortex-file-compressed -7.2% -2.6% -4.7% +14.6% ➖ noise
9 datafusion:arrow -17.0% -0.7% -16.5% +14.6% ✅ faster
9 datafusion:vortex-compact +5.9% -0.7% +6.6% +14.6% ➖ noise
9 datafusion:vortex-file-compressed -15.9% -0.7% -15.3% +14.6% ✅ faster
9 duckdb:duckdb -10.7% -0.7% -10.1% +14.6% ➖ noise
9 duckdb:vortex-compact -6.6% -0.7% -6.0% +14.6% ➖ noise
9 duckdb:vortex-file-compressed -8.6% -0.7% -7.9% +14.6% ➖ noise
10 datafusion:arrow -17.3% -5.0% -12.9% +14.6% ✅ faster
10 datafusion:vortex-compact +14.5% -5.0% +20.6% +14.6% 🚨 regression
10 datafusion:vortex-file-compressed -10.8% -5.0% -6.1% +14.6% ➖ noise
10 duckdb:duckdb -4.6% -5.0% +0.5% +14.6% ➖ noise
10 duckdb:vortex-compact -9.6% -5.0% -4.8% +14.6% ➖ noise
10 duckdb:vortex-file-compressed -10.3% -5.0% -5.5% +14.6% ➖ noise
11 datafusion:arrow -10.4% -6.0% -4.7% +14.6% ➖ noise
11 datafusion:vortex-compact +6.8% -6.0% +13.7% +14.6% ➖ noise
11 datafusion:vortex-file-compressed -1.6% -6.0% +4.7% +14.6% ➖ noise
11 duckdb:duckdb -7.6% -6.0% -1.7% +14.6% ➖ noise
11 duckdb:vortex-compact -8.3% -6.0% -2.4% +14.6% ➖ noise
11 duckdb:vortex-file-compressed -2.1% -6.0% +4.1% +14.6% ➖ noise
12 datafusion:arrow -13.5% -10.3% -3.6% +20.9% ➖ noise
12 datafusion:vortex-compact +8.9% -10.3% +21.3% +14.6% 🚨 regression
12 datafusion:vortex-file-compressed +8.5% -10.3% +20.9% +14.6% 🚨 regression
12 duckdb:duckdb -4.9% -10.3% +6.0% +14.6% ➖ noise
12 duckdb:vortex-compact -7.4% -10.3% +3.2% +14.6% ➖ noise
12 duckdb:vortex-file-compressed -8.9% -10.3% +1.6% +14.6% ➖ noise
13 datafusion:arrow -4.3% -12.0% +8.7% +14.6% ➖ noise
13 datafusion:vortex-compact +8.2% -12.0% +23.0% +14.6% 🚨 regression
13 datafusion:vortex-file-compressed -10.4% -12.0% +1.8% +14.6% ➖ noise
13 duckdb:duckdb -5.2% -12.0% +7.7% +14.6% ➖ noise
13 duckdb:vortex-compact -4.1% -12.0% +9.0% +14.6% ➖ noise
13 duckdb:vortex-file-compressed -9.7% -12.0% +2.6% +14.6% ➖ noise
14 datafusion:arrow -16.4% -2.4% -14.4% +14.6% ✅ faster
14 datafusion:vortex-compact +8.7% -2.4% +11.3% +14.6% ➖ noise
14 datafusion:vortex-file-compressed -7.0% -2.4% -4.7% +14.6% ➖ noise
14 duckdb:duckdb -8.9% -2.4% -6.7% +14.6% ➖ noise
14 duckdb:vortex-compact -10.1% -2.4% -7.9% +14.6% ➖ noise
14 duckdb:vortex-file-compressed -10.8% -2.4% -8.6% +14.6% ➖ noise
15 datafusion:arrow -16.2% -2.2% -14.3% +14.6% ✅ faster
15 datafusion:vortex-compact -6.2% -2.2% -4.1% +14.6% ➖ noise
15 datafusion:vortex-file-compressed -7.5% -2.2% -5.5% +14.6% ➖ noise
15 duckdb:duckdb -4.6% -2.2% -2.5% +14.6% ➖ noise
15 duckdb:vortex-compact -7.7% -2.2% -5.7% +14.6% ➖ noise
15 duckdb:vortex-file-compressed -9.1% -2.2% -7.1% +14.6% ➖ noise
16 datafusion:arrow -11.5% -11.1% -0.4% +14.6% ➖ noise
16 datafusion:vortex-compact -8.9% -11.1% +2.5% +14.6% ➖ noise
16 datafusion:vortex-file-compressed -11.8% -11.1% -0.8% +14.6% ➖ noise
16 duckdb:duckdb -6.7% -11.1% +5.0% +14.6% ➖ noise
16 duckdb:vortex-compact -6.8% -11.1% +4.9% +14.6% ➖ noise
16 duckdb:vortex-file-compressed -3.0% -11.1% +9.1% +14.6% ➖ noise
17 datafusion:arrow -16.0% -11.3% -5.2% +14.6% ➖ noise
17 datafusion:vortex-compact -11.7% -11.3% -0.4% +14.6% ➖ noise
17 datafusion:vortex-file-compressed +1.0% -11.3% +13.9% +14.6% ➖ noise
17 duckdb:duckdb -7.2% -11.3% +4.7% +14.6% ➖ noise
17 duckdb:vortex-compact +0.2% -11.3% +13.0% +14.6% ➖ noise
17 duckdb:vortex-file-compressed -13.1% -11.3% -1.9% +14.6% ➖ noise
18 datafusion:arrow -14.0% -8.4% -6.2% +14.6% ➖ noise
18 datafusion:vortex-compact -14.4% -8.4% -6.6% +14.6% ➖ noise
18 datafusion:vortex-file-compressed +9.7% -8.4% +19.7% +14.6% 🚨 regression
18 duckdb:duckdb -4.3% -8.4% +4.4% +14.6% ➖ noise
18 duckdb:vortex-compact +3.5% -8.4% +12.9% +14.6% ➖ noise
18 duckdb:vortex-file-compressed -8.7% -8.4% -0.4% +14.6% ➖ noise
19 datafusion:arrow -21.7% -5.9% -16.8% +17.5% ✅ faster
19 datafusion:vortex-compact -5.5% -5.9% +0.4% +14.6% ➖ noise
19 datafusion:vortex-file-compressed +4.0% -5.9% +10.4% +14.6% ➖ noise
19 duckdb:duckdb -9.7% -5.9% -4.0% +14.6% ➖ noise
19 duckdb:vortex-compact +3.9% -5.9% +10.4% +14.6% ➖ noise
19 duckdb:vortex-file-compressed -15.5% -5.9% -10.2% +14.6% ➖ noise
20 datafusion:arrow -18.0% -6.6% -12.2% +14.6% ➖ noise
20 datafusion:vortex-compact -9.7% -6.6% -3.3% +14.6% ➖ noise
20 datafusion:vortex-file-compressed +12.8% -6.6% +20.8% +14.6% 🚨 regression
20 duckdb:duckdb -4.7% -6.6% +2.0% +14.6% ➖ noise
20 duckdb:vortex-compact +3.1% -6.6% +10.4% +14.6% ➖ noise
20 duckdb:vortex-file-compressed -9.5% -6.6% -3.1% +14.6% ➖ noise
21 datafusion:arrow -16.0% -5.3% -11.3% +14.6% ➖ noise
21 datafusion:vortex-compact -12.8% -5.3% -7.9% +14.6% ➖ noise
21 datafusion:vortex-file-compressed +13.5% -5.3% +19.8% +14.6% 🚨 regression
21 duckdb:duckdb -8.2% -5.3% -3.1% +14.6% ➖ noise
21 duckdb:vortex-compact +4.0% -5.3% +9.7% +14.6% ➖ noise
21 duckdb:vortex-file-compressed -15.0% -5.3% -10.3% +14.6% ➖ noise
22 datafusion:arrow -6.7% -7.7% +1.0% +14.6% ➖ noise
22 datafusion:vortex-compact -13.1% -7.7% -5.9% +14.6% ➖ noise
22 datafusion:vortex-file-compressed +1.7% -7.7% +10.1% +14.6% ➖ noise
22 duckdb:duckdb -2.7% -7.7% +5.3% +14.6% ➖ noise
22 duckdb:vortex-compact -2.6% -7.7% +5.5% +14.6% ➖ noise
22 duckdb:vortex-file-compressed -10.7% -7.7% -3.3% +14.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: TPC-H SF=1 on NVME

File Size Changes (18 files changed, -0.0% overall, 0↑ 18↓)
File Scale Format Base HEAD Change %
lineitem_0.vortex 1.0 vortex-file-compressed 85.42 MB 85.42 MB 32 B -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.90 MB 84.90 MB 32 B -0.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 63.03 MB 32 B -0.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 63.00 MB 32 B -0.0%
orders_0.vortex 1.0 vortex-file-compressed 43.43 MB 43.43 MB 32 B -0.0%
partsupp_0.vortex 1.0 vortex-file-compressed 35.94 MB 35.94 MB 32 B -0.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 31.73 MB 32 B -0.0%
partsupp_0.vortex 1.0 vortex-compact 25.23 MB 25.23 MB 32 B -0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.50 MB 10.50 MB 32 B -0.0%
customer_0.vortex 1.0 vortex-compact 7.43 MB 7.43 MB 32 B -0.0%
part_0.vortex 1.0 vortex-file-compressed 5.44 MB 5.44 MB 32 B -0.0%
part_0.vortex 1.0 vortex-compact 3.64 MB 3.64 MB 32 B -0.0%
supplier_0.vortex 1.0 vortex-file-compressed 706.34 KB 706.31 KB 32 B -0.0%
supplier_0.vortex 1.0 vortex-compact 496.72 KB 496.69 KB 32 B -0.0%
nation_0.vortex 1.0 vortex-file-compressed 11.00 KB 10.97 KB 32 B -0.3%
nation_0.vortex 1.0 vortex-compact 8.34 KB 8.31 KB 32 B -0.4%
region_0.vortex 1.0 vortex-file-compressed 6.16 KB 6.13 KB 32 B -0.5%
region_0.vortex 1.0 vortex-compact 5.86 KB 5.82 KB 32 B -0.5%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (-0.0%)
  • vortex-file-compressed: 266.61 MB → 266.60 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.6%

datafusion / vortex-file-compressed (1.033x ➖, 0↑ 6↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25156828 25852082 0.97
tpcds_q02/datafusion:vortex-file-compressed 48946065 49506079 0.99
tpcds_q03/datafusion:vortex-file-compressed 15204735 15193384 1.00
tpcds_q04/datafusion:vortex-file-compressed 268174024 255329302 1.05
tpcds_q05/datafusion:vortex-file-compressed 44021102 42364545 1.04
tpcds_q06/datafusion:vortex-file-compressed 59791591 59156565 1.01
tpcds_q07/datafusion:vortex-file-compressed 41511133 40946271 1.01
tpcds_q08/datafusion:vortex-file-compressed 🚨 32163064 28563548 1.13
tpcds_q09/datafusion:vortex-file-compressed 🚨 43705976 38862493 1.12
tpcds_q10/datafusion:vortex-file-compressed 39962543 38488785 1.04
tpcds_q11/datafusion:vortex-file-compressed 133796952 130625537 1.02
tpcds_q12/datafusion:vortex-file-compressed 19428066 18904476 1.03
tpcds_q13/datafusion:vortex-file-compressed 🚨 48187176 40135106 1.20
tpcds_q14/datafusion:vortex-file-compressed 170454322 166920626 1.02
tpcds_q15/datafusion:vortex-file-compressed 27698890 28364943 0.98
tpcds_q16/datafusion:vortex-file-compressed 29521320 28934730 1.02
tpcds_q17/datafusion:vortex-file-compressed 64411121 61530732 1.05
tpcds_q18/datafusion:vortex-file-compressed 71135560 68448151 1.04
tpcds_q19/datafusion:vortex-file-compressed 22321112 21634552 1.03
tpcds_q20/datafusion:vortex-file-compressed 21207094 22030188 0.96
tpcds_q21/datafusion:vortex-file-compressed 35180110 35683883 0.99
tpcds_q22/datafusion:vortex-file-compressed 113358958 112728321 1.01
tpcds_q23/datafusion:vortex-file-compressed 159029620 154586914 1.03
tpcds_q24/datafusion:vortex-file-compressed 84532566 83950687 1.01
tpcds_q25/datafusion:vortex-file-compressed 65566206 65141797 1.01
tpcds_q26/datafusion:vortex-file-compressed 34548648 33729907 1.02
tpcds_q27/datafusion:vortex-file-compressed 102658094 100944007 1.02
tpcds_q28/datafusion:vortex-file-compressed 33833664 33768834 1.00
tpcds_q29/datafusion:vortex-file-compressed 65321836 63142166 1.03
tpcds_q30/datafusion:vortex-file-compressed 23644920 22799523 1.04
tpcds_q31/datafusion:vortex-file-compressed 75172905 76877535 0.98
tpcds_q32/datafusion:vortex-file-compressed 20771148 20130702 1.03
tpcds_q33/datafusion:vortex-file-compressed 30558457 30235253 1.01
tpcds_q34/datafusion:vortex-file-compressed 24814778 23810945 1.04
tpcds_q35/datafusion:vortex-file-compressed 46269163 45174165 1.02
tpcds_q36/datafusion:vortex-file-compressed 58174940 57265137 1.02
tpcds_q37/datafusion:vortex-file-compressed 24907905 23624944 1.05
tpcds_q38/datafusion:vortex-file-compressed 44280349 42689673 1.04
tpcds_q39/datafusion:vortex-file-compressed 109059820 105996885 1.03
tpcds_q40/datafusion:vortex-file-compressed 33338838 32812016 1.02
tpcds_q41/datafusion:vortex-file-compressed 16352868 15158882 1.08
tpcds_q42/datafusion:vortex-file-compressed 14218456 14232104 1.00
tpcds_q43/datafusion:vortex-file-compressed 19446628 18687570 1.04
tpcds_q44/datafusion:vortex-file-compressed 32947345 32953714 1.00
tpcds_q45/datafusion:vortex-file-compressed 27956881 27322794 1.02
tpcds_q46/datafusion:vortex-file-compressed 34264627 34470930 0.99
tpcds_q47/datafusion:vortex-file-compressed 135135401 131335876 1.03
tpcds_q48/datafusion:vortex-file-compressed 37432320 35482426 1.05
tpcds_q49/datafusion:vortex-file-compressed 58251975 57335818 1.02
tpcds_q50/datafusion:vortex-file-compressed 40727760 38844584 1.05
tpcds_q51/datafusion:vortex-file-compressed 89474191 86427519 1.04
tpcds_q52/datafusion:vortex-file-compressed 14716688 13570710 1.08
tpcds_q53/datafusion:vortex-file-compressed 21292308 20745292 1.03
tpcds_q54/datafusion:vortex-file-compressed 35211562 34378857 1.02
tpcds_q55/datafusion:vortex-file-compressed 14215120 14512545 0.98
tpcds_q56/datafusion:vortex-file-compressed 30215784 29098183 1.04
tpcds_q57/datafusion:vortex-file-compressed 111380144 104433438 1.07
tpcds_q58/datafusion:vortex-file-compressed 52385332 52256462 1.00
tpcds_q59/datafusion:vortex-file-compressed 56234596 56381303 1.00
tpcds_q60/datafusion:vortex-file-compressed 30387340 29391162 1.03
tpcds_q61/datafusion:vortex-file-compressed 41613669 40393295 1.03
tpcds_q62/datafusion:vortex-file-compressed 🚨 27473499 20972489 1.31
tpcds_q63/datafusion:vortex-file-compressed 21679970 20883097 1.04
tpcds_q64/datafusion:vortex-file-compressed 425016436 400415341 1.06
tpcds_q65/datafusion:vortex-file-compressed 39300892 40123571 0.98
tpcds_q66/datafusion:vortex-file-compressed 73125557 71961221 1.02
tpcds_q67/datafusion:vortex-file-compressed 152026914 146879782 1.04
tpcds_q68/datafusion:vortex-file-compressed 33160809 32470555 1.02
tpcds_q69/datafusion:vortex-file-compressed 36969134 35581809 1.04
tpcds_q70/datafusion:vortex-file-compressed 86602488 84852540 1.02
tpcds_q71/datafusion:vortex-file-compressed 23390712 22891066 1.02
tpcds_q72/datafusion:vortex-file-compressed 2188035668 2111771055 1.04
tpcds_q73/datafusion:vortex-file-compressed 23160010 22113346 1.05
tpcds_q74/datafusion:vortex-file-compressed 79875846 80413314 0.99
tpcds_q75/datafusion:vortex-file-compressed 108081257 104727792 1.03
tpcds_q76/datafusion:vortex-file-compressed 🚨 32188880 23769608 1.35
tpcds_q77/datafusion:vortex-file-compressed 41508042 40384763 1.03
tpcds_q78/datafusion:vortex-file-compressed 124191819 122703857 1.01
tpcds_q79/datafusion:vortex-file-compressed 27727597 27376775 1.01
tpcds_q80/datafusion:vortex-file-compressed 93022133 92588146 1.00
tpcds_q81/datafusion:vortex-file-compressed 24659047 23917995 1.03
tpcds_q82/datafusion:vortex-file-compressed 25071773 25598450 0.98
tpcds_q83/datafusion:vortex-file-compressed 🚨 37009727 33156299 1.12
tpcds_q84/datafusion:vortex-file-compressed 12797707 12247848 1.04
tpcds_q85/datafusion:vortex-file-compressed 92077960 90233851 1.02
tpcds_q86/datafusion:vortex-file-compressed 16146348 16326646 0.99
tpcds_q87/datafusion:vortex-file-compressed 45083544 41862817 1.08
tpcds_q88/datafusion:vortex-file-compressed 56301275 54895639 1.03
tpcds_q89/datafusion:vortex-file-compressed 24733502 25055464 0.99
tpcds_q90/datafusion:vortex-file-compressed 14719718 14361310 1.02
tpcds_q91/datafusion:vortex-file-compressed 18549040 18091048 1.03
tpcds_q92/datafusion:vortex-file-compressed 18564370 17235043 1.08
tpcds_q93/datafusion:vortex-file-compressed 34180123 33889338 1.01
tpcds_q94/datafusion:vortex-file-compressed 24550350 22556755 1.09
tpcds_q95/datafusion:vortex-file-compressed 62523812 60300302 1.04
tpcds_q96/datafusion:vortex-file-compressed 14276089 13961269 1.02
tpcds_q97/datafusion:vortex-file-compressed 31553443 30893689 1.02
tpcds_q98/datafusion:vortex-file-compressed 24043960 23463230 1.02
tpcds_q99/datafusion:vortex-file-compressed 31609341 31601127 1.00
datafusion / vortex-compact (1.025x ➖, 0↑ 3↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25951685 25272379 1.03
tpcds_q02/datafusion:vortex-compact 55163654 52406616 1.05
tpcds_q03/datafusion:vortex-compact 19739235 19586811 1.01
tpcds_q04/datafusion:vortex-compact 300609197 282859447 1.06
tpcds_q05/datafusion:vortex-compact 48852612 46678135 1.05
tpcds_q06/datafusion:vortex-compact 63228880 60300119 1.05
tpcds_q07/datafusion:vortex-compact 51941738 52031426 1.00
tpcds_q08/datafusion:vortex-compact 35914286 36227614 0.99
tpcds_q09/datafusion:vortex-compact 52059267 52628745 0.99
tpcds_q10/datafusion:vortex-compact 49932125 48873123 1.02
tpcds_q11/datafusion:vortex-compact 156361677 151852913 1.03
tpcds_q12/datafusion:vortex-compact 24583624 24059798 1.02
tpcds_q13/datafusion:vortex-compact 132228077 122901511 1.08
tpcds_q14/datafusion:vortex-compact 203190825 196510006 1.03
tpcds_q15/datafusion:vortex-compact 31499712 30993583 1.02
tpcds_q16/datafusion:vortex-compact 33155643 32359007 1.02
tpcds_q17/datafusion:vortex-compact 73126938 73491216 1.00
tpcds_q18/datafusion:vortex-compact 79117004 77647176 1.02
tpcds_q19/datafusion:vortex-compact 29994014 29602865 1.01
tpcds_q20/datafusion:vortex-compact 26849023 25343769 1.06
tpcds_q21/datafusion:vortex-compact 40328413 38665439 1.04
tpcds_q22/datafusion:vortex-compact 130887858 123196756 1.06
tpcds_q23/datafusion:vortex-compact 170310685 164667424 1.03
tpcds_q24/datafusion:vortex-compact 96539047 103499838 0.93
tpcds_q25/datafusion:vortex-compact 79880189 77772830 1.03
tpcds_q26/datafusion:vortex-compact 45890949 44025663 1.04
tpcds_q27/datafusion:vortex-compact 127668638 126551963 1.01
tpcds_q28/datafusion:vortex-compact 102464206 94989549 1.08
tpcds_q29/datafusion:vortex-compact 73977528 72764485 1.02
tpcds_q30/datafusion:vortex-compact 29353713 26738334 1.10
tpcds_q31/datafusion:vortex-compact 97301776 97319088 1.00
tpcds_q32/datafusion:vortex-compact 24987593 24910014 1.00
tpcds_q33/datafusion:vortex-compact 36135867 36872681 0.98
tpcds_q34/datafusion:vortex-compact 33073552 32394406 1.02
tpcds_q35/datafusion:vortex-compact 52940310 51487147 1.03
tpcds_q36/datafusion:vortex-compact 77074047 75911814 1.02
tpcds_q37/datafusion:vortex-compact 35085304 33118016 1.06
tpcds_q38/datafusion:vortex-compact 52691710 49936605 1.06
tpcds_q39/datafusion:vortex-compact 111904200 110943659 1.01
tpcds_q40/datafusion:vortex-compact 35945466 36228439 0.99
tpcds_q41/datafusion:vortex-compact 17186573 16514556 1.04
tpcds_q42/datafusion:vortex-compact 18073608 17489354 1.03
tpcds_q43/datafusion:vortex-compact 25009537 24843985 1.01
tpcds_q44/datafusion:vortex-compact 47669083 47389714 1.01
tpcds_q45/datafusion:vortex-compact 32362372 32517918 1.00
tpcds_q46/datafusion:vortex-compact 44043804 44663272 0.99
tpcds_q47/datafusion:vortex-compact 151984595 148123820 1.03
tpcds_q48/datafusion:vortex-compact 83803556 79835129 1.05
tpcds_q49/datafusion:vortex-compact 69622803 68270511 1.02
tpcds_q50/datafusion:vortex-compact 47036246 46537443 1.01
tpcds_q51/datafusion:vortex-compact 95330399 96025151 0.99
tpcds_q52/datafusion:vortex-compact 18576905 18303648 1.01
tpcds_q53/datafusion:vortex-compact 27803285 27454485 1.01
tpcds_q54/datafusion:vortex-compact 42012760 41881096 1.00
tpcds_q55/datafusion:vortex-compact 17766711 18413980 0.96
tpcds_q56/datafusion:vortex-compact 35822985 34682758 1.03
tpcds_q57/datafusion:vortex-compact 117739624 114182195 1.03
tpcds_q58/datafusion:vortex-compact 60594473 61292509 0.99
tpcds_q59/datafusion:vortex-compact 69801116 68999390 1.01
tpcds_q60/datafusion:vortex-compact 36718514 34936055 1.05
tpcds_q61/datafusion:vortex-compact 54497403 54289613 1.00
tpcds_q62/datafusion:vortex-compact 🚨 31013014 23770634 1.30
tpcds_q63/datafusion:vortex-compact 28329050 28232985 1.00
tpcds_q64/datafusion:vortex-compact 469271407 448599474 1.05
tpcds_q65/datafusion:vortex-compact 53525673 52904087 1.01
tpcds_q66/datafusion:vortex-compact 77711757 76548034 1.02
tpcds_q67/datafusion:vortex-compact 156228103 163692055 0.95
tpcds_q68/datafusion:vortex-compact 44502364 46048835 0.97
tpcds_q69/datafusion:vortex-compact 47729680 47004294 1.02
tpcds_q70/datafusion:vortex-compact 99568654 100806920 0.99
tpcds_q71/datafusion:vortex-compact 30163090 32641010 0.92
tpcds_q72/datafusion:vortex-compact 2167367627 2133703098 1.02
tpcds_q73/datafusion:vortex-compact 31202384 30804331 1.01
tpcds_q74/datafusion:vortex-compact 97527511 95405598 1.02
tpcds_q75/datafusion:vortex-compact 129961458 127425994 1.02
tpcds_q76/datafusion:vortex-compact 32879231 30465805 1.08
tpcds_q77/datafusion:vortex-compact 50426125 51675513 0.98
tpcds_q78/datafusion:vortex-compact 140923807 137327240 1.03
tpcds_q79/datafusion:vortex-compact 39723314 36738379 1.08
tpcds_q80/datafusion:vortex-compact 105874872 101750004 1.04
tpcds_q81/datafusion:vortex-compact 28020154 27221432 1.03
tpcds_q82/datafusion:vortex-compact 34571813 34373220 1.01
tpcds_q83/datafusion:vortex-compact 34064193 32847296 1.04
tpcds_q84/datafusion:vortex-compact 15096804 13923703 1.08
tpcds_q85/datafusion:vortex-compact 🚨 175160672 155199781 1.13
tpcds_q86/datafusion:vortex-compact 🚨 21787505 17720305 1.23
tpcds_q87/datafusion:vortex-compact 52100943 49951372 1.04
tpcds_q88/datafusion:vortex-compact 76401681 76312863 1.00
tpcds_q89/datafusion:vortex-compact 31289634 31716242 0.99
tpcds_q90/datafusion:vortex-compact 15248052 14610030 1.04
tpcds_q91/datafusion:vortex-compact 32725834 32398151 1.01
tpcds_q92/datafusion:vortex-compact 22536443 23059626 0.98
tpcds_q93/datafusion:vortex-compact 38848559 37360827 1.04
tpcds_q94/datafusion:vortex-compact 27752683 26333240 1.05
tpcds_q95/datafusion:vortex-compact 66318229 64295574 1.03
tpcds_q96/datafusion:vortex-compact 17428030 17353004 1.00
tpcds_q97/datafusion:vortex-compact 36094511 35502549 1.02
tpcds_q98/datafusion:vortex-compact 30957497 30031203 1.03
tpcds_q99/datafusion:vortex-compact 35462238 34241485 1.04
datafusion / parquet (1.010x ➖, 0↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30158798 29968182 1.01
tpcds_q02/datafusion:parquet 42446233 43809942 0.97
tpcds_q03/datafusion:parquet 13075912 13413403 0.97
tpcds_q04/datafusion:parquet 266692299 285207526 0.94
tpcds_q05/datafusion:parquet 40638803 41724475 0.97
tpcds_q06/datafusion:parquet 59548761 59101504 1.01
tpcds_q07/datafusion:parquet 78885951 76330553 1.03
tpcds_q08/datafusion:parquet 27438825 26241467 1.05
tpcds_q09/datafusion:parquet 45335786 44905695 1.01
tpcds_q10/datafusion:parquet 74086071 67910447 1.09
tpcds_q11/datafusion:parquet 153383631 154056658 1.00
tpcds_q12/datafusion:parquet 18132649 18362128 0.99
tpcds_q13/datafusion:parquet 77933433 75514775 1.03
tpcds_q14/datafusion:parquet 163097851 167911863 0.97
tpcds_q15/datafusion:parquet 21572582 22238105 0.97
tpcds_q16/datafusion:parquet 24137778 23957304 1.01
tpcds_q17/datafusion:parquet 62370560 63916534 0.98
tpcds_q18/datafusion:parquet 116349834 114502324 1.02
tpcds_q19/datafusion:parquet 22648054 22772969 0.99
tpcds_q20/datafusion:parquet 16213244 16277269 1.00
tpcds_q21/datafusion:parquet 18399832 19277799 0.95
tpcds_q22/datafusion:parquet 🚨 178249181 148134120 1.20
tpcds_q23/datafusion:parquet 144553444 148397771 0.97
tpcds_q24/datafusion:parquet 91208710 89757857 1.02
tpcds_q25/datafusion:parquet 65843476 65573875 1.00
tpcds_q26/datafusion:parquet 64089446 64464379 0.99
tpcds_q27/datafusion:parquet 150514008 146593041 1.03
tpcds_q28/datafusion:parquet 46300627 46618920 0.99
tpcds_q29/datafusion:parquet 64709185 65503160 0.99
tpcds_q30/datafusion:parquet 35885063 34490155 1.04
tpcds_q31/datafusion:parquet 66062543 64992732 1.02
tpcds_q32/datafusion:parquet 18245325 18007991 1.01
tpcds_q33/datafusion:parquet 26457958 27930044 0.95
tpcds_q34/datafusion:parquet 20696456 20836205 0.99
tpcds_q35/datafusion:parquet 69376152 68433965 1.01
tpcds_q36/datafusion:parquet 58691144 57149998 1.03
tpcds_q37/datafusion:parquet 20069486 18757852 1.07
tpcds_q38/datafusion:parquet 41804792 39987481 1.05
tpcds_q39/datafusion:parquet 73147453 73428560 1.00
tpcds_q40/datafusion:parquet 23441658 23702330 0.99
tpcds_q41/datafusion:parquet 13640276 13115351 1.04
tpcds_q42/datafusion:parquet 11757066 11928590 0.99
tpcds_q43/datafusion:parquet 17473497 16834651 1.04
tpcds_q44/datafusion:parquet 33480066 32930261 1.02
tpcds_q45/datafusion:parquet 29573736 27709812 1.07
tpcds_q46/datafusion:parquet 32124378 31112754 1.03
tpcds_q47/datafusion:parquet 126235302 125350023 1.01
tpcds_q48/datafusion:parquet 68632185 67890690 1.01
tpcds_q49/datafusion:parquet 56086792 55189877 1.02
tpcds_q50/datafusion:parquet 43040360 43108213 1.00
tpcds_q51/datafusion:parquet 83140592 83610404 0.99
tpcds_q52/datafusion:parquet 12486296 12132269 1.03
tpcds_q53/datafusion:parquet 17596715 17496247 1.01
tpcds_q54/datafusion:parquet 34341509 34222068 1.00
tpcds_q55/datafusion:parquet 11200830 11225476 1.00
tpcds_q56/datafusion:parquet 27454679 26796473 1.02
tpcds_q57/datafusion:parquet 96862814 92313382 1.05
tpcds_q58/datafusion:parquet 50041171 49560211 1.01
tpcds_q59/datafusion:parquet 57469213 57426037 1.00
tpcds_q60/datafusion:parquet 27421076 27933665 0.98
tpcds_q61/datafusion:parquet 41768624 42009228 0.99
tpcds_q62/datafusion:parquet 25025033 25107031 1.00
tpcds_q63/datafusion:parquet 17812251 17566016 1.01
tpcds_q64/datafusion:parquet 519481975 515446143 1.01
tpcds_q65/datafusion:parquet 38028798 37231462 1.02
tpcds_q66/datafusion:parquet 72580304 66238262 1.10
tpcds_q67/datafusion:parquet 142654072 145085774 0.98
tpcds_q68/datafusion:parquet 31266099 31461997 0.99
tpcds_q69/datafusion:parquet 66652527 63079367 1.06
tpcds_q70/datafusion:parquet 86699846 84846580 1.02
tpcds_q71/datafusion:parquet 22733576 22746347 1.00
tpcds_q72/datafusion:parquet 619269119 604164611 1.03
tpcds_q73/datafusion:parquet 22743836 20783157 1.09
tpcds_q74/datafusion:parquet 81070817 83144728 0.98
tpcds_q75/datafusion:parquet 99188994 97582443 1.02
tpcds_q76/datafusion:parquet 29467126 31290440 0.94
tpcds_q77/datafusion:parquet 38883098 39554697 0.98
tpcds_q78/datafusion:parquet 114719325 113578724 1.01
tpcds_q79/datafusion:parquet 26450875 26505599 1.00
tpcds_q80/datafusion:parquet 79637553 79020684 1.01
tpcds_q81/datafusion:parquet 31972123 31235660 1.02
tpcds_q82/datafusion:parquet 19099360 18946727 1.01
tpcds_q83/datafusion:parquet 36264742 36072969 1.01
tpcds_q84/datafusion:parquet 39314114 38522786 1.02
tpcds_q85/datafusion:parquet 147164430 146322616 1.01
tpcds_q86/datafusion:parquet 16224779 15545240 1.04
tpcds_q87/datafusion:parquet 40885921 41291517 0.99
tpcds_q88/datafusion:parquet 59553248 59014241 1.01
tpcds_q89/datafusion:parquet 21363168 20837015 1.03
tpcds_q90/datafusion:parquet 14158416 14004608 1.01
tpcds_q91/datafusion:parquet 59126362 56602238 1.04
tpcds_q92/datafusion:parquet 18264643 17583447 1.04
tpcds_q93/datafusion:parquet 32670549 32221584 1.01
tpcds_q94/datafusion:parquet 19559234 20346447 0.96
tpcds_q95/datafusion:parquet 58794797 59591154 0.99
tpcds_q96/datafusion:parquet 12624299 12028091 1.05
tpcds_q97/datafusion:parquet 28885897 28891513 1.00
tpcds_q98/datafusion:parquet 22197046 20681547 1.07
tpcds_q99/datafusion:parquet 25875684 28265780 0.92
duckdb / vortex-file-compressed (1.007x ➖, 7↑ 2↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 23854373 26949636 0.89
tpcds_q02/duckdb:vortex-file-compressed 36657521 34178254 1.07
tpcds_q03/duckdb:vortex-file-compressed 26608665 26485765 1.00
tpcds_q04/duckdb:vortex-file-compressed 93863323 95224060 0.99
tpcds_q05/duckdb:vortex-file-compressed 33881920 33446573 1.01
tpcds_q06/duckdb:vortex-file-compressed 33511899 33197290 1.01
tpcds_q07/duckdb:vortex-file-compressed 21675978 21586995 1.00
tpcds_q08/duckdb:vortex-file-compressed 29507629 26889807 1.10
tpcds_q09/duckdb:vortex-file-compressed 15894280 16047852 0.99
tpcds_q10/duckdb:vortex-file-compressed 37333527 36794545 1.01
tpcds_q11/duckdb:vortex-file-compressed 65178469 64404220 1.01
tpcds_q12/duckdb:vortex-file-compressed 16341263 15529571 1.05
tpcds_q13/duckdb:vortex-file-compressed 33129292 32974865 1.00
tpcds_q14/duckdb:vortex-file-compressed 97811783 96446034 1.01
tpcds_q15/duckdb:vortex-file-compressed 27086074 26107752 1.04
tpcds_q16/duckdb:vortex-file-compressed 26904388 25994709 1.03
tpcds_q17/duckdb:vortex-file-compressed 45139325 45713346 0.99
tpcds_q18/duckdb:vortex-file-compressed 38235335 37509853 1.02
tpcds_q19/duckdb:vortex-file-compressed 31941313 31159890 1.03
tpcds_q20/duckdb:vortex-file-compressed 17350829 16577191 1.05
tpcds_q21/duckdb:vortex-file-compressed 17245271 17236931 1.00
tpcds_q22/duckdb:vortex-file-compressed 76823430 76297713 1.01
tpcds_q23/duckdb:vortex-file-compressed 96868649 105074989 0.92
tpcds_q24/duckdb:vortex-file-compressed 48388075 47081244 1.03
tpcds_q25/duckdb:vortex-file-compressed 🚀 42850524 51124632 0.84
tpcds_q26/duckdb:vortex-file-compressed 19541265 20080554 0.97
tpcds_q27/duckdb:vortex-file-compressed 23592506 23032990 1.02
tpcds_q28/duckdb:vortex-file-compressed 12799583 12695164 1.01
tpcds_q29/duckdb:vortex-file-compressed 40757769 42947132 0.95
tpcds_q30/duckdb:vortex-file-compressed 26606090 25823018 1.03
tpcds_q31/duckdb:vortex-file-compressed 29347773 28291145 1.04
tpcds_q32/duckdb:vortex-file-compressed 13998361 13653796 1.03
tpcds_q33/duckdb:vortex-file-compressed 24512094 22877290 1.07
tpcds_q34/duckdb:vortex-file-compressed 24682409 24541257 1.01
tpcds_q35/duckdb:vortex-file-compressed 64438348 65449460 0.98
tpcds_q36/duckdb:vortex-file-compressed 24078564 24978425 0.96
tpcds_q37/duckdb:vortex-file-compressed 20588297 19868527 1.04
tpcds_q38/duckdb:vortex-file-compressed 36043406 35589703 1.01
tpcds_q39/duckdb:vortex-file-compressed 35533310 35466147 1.00
tpcds_q40/duckdb:vortex-file-compressed 20219814 19373688 1.04
tpcds_q41/duckdb:vortex-file-compressed 10144565 10133734 1.00
tpcds_q42/duckdb:vortex-file-compressed 13364493 13578565 0.98
tpcds_q43/duckdb:vortex-file-compressed 20349009 21317284 0.95
tpcds_q44/duckdb:vortex-file-compressed 21565077 20727586 1.04
tpcds_q45/duckdb:vortex-file-compressed 31042433 29425839 1.05
tpcds_q46/duckdb:vortex-file-compressed 32533602 33929207 0.96
tpcds_q47/duckdb:vortex-file-compressed 53195731 52508971 1.01
tpcds_q48/duckdb:vortex-file-compressed 29397599 28703645 1.02
tpcds_q49/duckdb:vortex-file-compressed 34211536 33137241 1.03
tpcds_q50/duckdb:vortex-file-compressed 🚀 26478605 29940817 0.88
tpcds_q51/duckdb:vortex-file-compressed 103618495 104543005 0.99
tpcds_q52/duckdb:vortex-file-compressed 13366469 13085909 1.02
tpcds_q53/duckdb:vortex-file-compressed 22918255 22276808 1.03
tpcds_q54/duckdb:vortex-file-compressed 29083203 27980552 1.04
tpcds_q55/duckdb:vortex-file-compressed 12811579 12234624 1.05
tpcds_q56/duckdb:vortex-file-compressed 25613337 24600202 1.04
tpcds_q57/duckdb:vortex-file-compressed 42139631 41992174 1.00
tpcds_q58/duckdb:vortex-file-compressed 29068465 29488557 0.99
tpcds_q59/duckdb:vortex-file-compressed 🚀 56197881 67523802 0.83
tpcds_q60/duckdb:vortex-file-compressed 27028076 25523971 1.06
tpcds_q61/duckdb:vortex-file-compressed 30244787 30456459 0.99
tpcds_q62/duckdb:vortex-file-compressed 16115303 15341496 1.05
tpcds_q63/duckdb:vortex-file-compressed 20765043 20468523 1.01
tpcds_q64/duckdb:vortex-file-compressed 100273448 100286076 1.00
tpcds_q65/duckdb:vortex-file-compressed 22217834 22961209 0.97
tpcds_q66/duckdb:vortex-file-compressed 30501175 28057824 1.09
tpcds_q67/duckdb:vortex-file-compressed 146591297 140235950 1.05
tpcds_q68/duckdb:vortex-file-compressed 29531138 31155005 0.95
tpcds_q69/duckdb:vortex-file-compressed 41786992 39689846 1.05
tpcds_q70/duckdb:vortex-file-compressed 38189577 37311831 1.02
tpcds_q71/duckdb:vortex-file-compressed 20861522 20625317 1.01
tpcds_q72/duckdb:vortex-file-compressed 170208978 169402982 1.00
tpcds_q73/duckdb:vortex-file-compressed 24845816 24525440 1.01
tpcds_q74/duckdb:vortex-file-compressed 43710755 41813607 1.05
tpcds_q75/duckdb:vortex-file-compressed 50586649 50287468 1.01
tpcds_q76/duckdb:vortex-file-compressed 🚨 21001077 17226204 1.22
tpcds_q77/duckdb:vortex-file-compressed 23365017 22461401 1.04
tpcds_q78/duckdb:vortex-file-compressed 78844248 81156774 0.97
tpcds_q79/duckdb:vortex-file-compressed 23996717 25408438 0.94
tpcds_q80/duckdb:vortex-file-compressed 46477832 46817046 0.99
tpcds_q81/duckdb:vortex-file-compressed 31342557 29088571 1.08
tpcds_q82/duckdb:vortex-file-compressed 46824662 47055970 1.00
tpcds_q83/duckdb:vortex-file-compressed 27851184 26262241 1.06
tpcds_q84/duckdb:vortex-file-compressed 🚀 17470386 20338565 0.86
tpcds_q85/duckdb:vortex-file-compressed 🚀 40819357 46085509 0.89
tpcds_q86/duckdb:vortex-file-compressed 16450104 17635736 0.93
tpcds_q87/duckdb:vortex-file-compressed 41014202 40319542 1.02
tpcds_q88/duckdb:vortex-file-compressed 53956919 50994918 1.06
tpcds_q89/duckdb:vortex-file-compressed 23059997 21216092 1.09
tpcds_q90/duckdb:vortex-file-compressed 11091443 10264792 1.08
tpcds_q91/duckdb:vortex-file-compressed 22499430 24666839 0.91
tpcds_q92/duckdb:vortex-file-compressed 20066162 18930769 1.06
tpcds_q93/duckdb:vortex-file-compressed 29296694 29199712 1.00
tpcds_q94/duckdb:vortex-file-compressed 22257510 20860903 1.07
tpcds_q95/duckdb:vortex-file-compressed 163858329 155929140 1.05
tpcds_q96/duckdb:vortex-file-compressed 🚨 12828702 11647854 1.10
tpcds_q97/duckdb:vortex-file-compressed 38813834 38806402 1.00
tpcds_q98/duckdb:vortex-file-compressed 19357692 18845447 1.03
tpcds_q99/duckdb:vortex-file-compressed 🚀 22688663 26607619 0.85
duckdb / vortex-compact (1.013x ➖, 5↑ 4↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 27035958 24909635 1.09
tpcds_q02/duckdb:vortex-compact 🚨 39508680 32235957 1.23
tpcds_q03/duckdb:vortex-compact 49257487 49577151 0.99
tpcds_q04/duckdb:vortex-compact 102162038 104446093 0.98
tpcds_q05/duckdb:vortex-compact 41754772 40985788 1.02
tpcds_q06/duckdb:vortex-compact 38857564 38172107 1.02
tpcds_q07/duckdb:vortex-compact 35664520 34168754 1.04
tpcds_q08/duckdb:vortex-compact 41301212 41584426 0.99
tpcds_q09/duckdb:vortex-compact 19580884 20697321 0.95
tpcds_q10/duckdb:vortex-compact 54220617 51950825 1.04
tpcds_q11/duckdb:vortex-compact 76167308 71936293 1.06
tpcds_q12/duckdb:vortex-compact 21853493 21613181 1.01
tpcds_q13/duckdb:vortex-compact 52099615 50793364 1.03
tpcds_q14/duckdb:vortex-compact 122886269 116456683 1.06
tpcds_q15/duckdb:vortex-compact 30683774 30956087 0.99
tpcds_q16/duckdb:vortex-compact 28383414 26350415 1.08
tpcds_q17/duckdb:vortex-compact 58527500 55350805 1.06
tpcds_q18/duckdb:vortex-compact 50772072 49812145 1.02
tpcds_q19/duckdb:vortex-compact 44360812 42844932 1.04
tpcds_q20/duckdb:vortex-compact 21076739 20557199 1.03
tpcds_q21/duckdb:vortex-compact 18614113 17922566 1.04
tpcds_q22/duckdb:vortex-compact 80924254 80006901 1.01
tpcds_q23/duckdb:vortex-compact 🚀 100065743 114907576 0.87
tpcds_q24/duckdb:vortex-compact 59285248 57000665 1.04
tpcds_q25/duckdb:vortex-compact 🚀 58022931 80981293 0.72
tpcds_q26/duckdb:vortex-compact 31718321 30511095 1.04
tpcds_q27/duckdb:vortex-compact 37584160 35556948 1.06
tpcds_q28/duckdb:vortex-compact 34658311 33408675 1.04
tpcds_q29/duckdb:vortex-compact 53810580 53851136 1.00
tpcds_q30/duckdb:vortex-compact 29561605 30119046 0.98
tpcds_q31/duckdb:vortex-compact 36959372 34339388 1.08
tpcds_q32/duckdb:vortex-compact 22023306 20691101 1.06
tpcds_q33/duckdb:vortex-compact 33232734 32404978 1.03
tpcds_q34/duckdb:vortex-compact 31595832 30556513 1.03
tpcds_q35/duckdb:vortex-compact 78057860 73791270 1.06
tpcds_q36/duckdb:vortex-compact 36465807 36534066 1.00
tpcds_q37/duckdb:vortex-compact 24276936 23491091 1.03
tpcds_q38/duckdb:vortex-compact 41719837 40498397 1.03
tpcds_q39/duckdb:vortex-compact 39880755 37468292 1.06
tpcds_q40/duckdb:vortex-compact 24217773 24098218 1.00
tpcds_q41/duckdb:vortex-compact 12189790 11771794 1.04
tpcds_q42/duckdb:vortex-compact 19786487 19487540 1.02
tpcds_q43/duckdb:vortex-compact 32448203 32464680 1.00
tpcds_q44/duckdb:vortex-compact 30030791 28699102 1.05
tpcds_q45/duckdb:vortex-compact 37163839 36767349 1.01
tpcds_q46/duckdb:vortex-compact 44416641 44931733 0.99
tpcds_q47/duckdb:vortex-compact 62887876 62096842 1.01
tpcds_q48/duckdb:vortex-compact 45770213 45084569 1.02
tpcds_q49/duckdb:vortex-compact 50493419 51106068 0.99
tpcds_q50/duckdb:vortex-compact 40558096 37109973 1.09
tpcds_q51/duckdb:vortex-compact 112567845 111317386 1.01
tpcds_q52/duckdb:vortex-compact 🚨 20938991 18462951 1.13
tpcds_q53/duckdb:vortex-compact 33284524 32265021 1.03
tpcds_q54/duckdb:vortex-compact 37966634 38801737 0.98
tpcds_q55/duckdb:vortex-compact 18162378 18834060 0.96
tpcds_q56/duckdb:vortex-compact 🚨 34684335 30512618 1.14
tpcds_q57/duckdb:vortex-compact 46557239 44586035 1.04
tpcds_q58/duckdb:vortex-compact 37974717 36345332 1.04
tpcds_q59/duckdb:vortex-compact 🚀 65362111 88466593 0.74
tpcds_q60/duckdb:vortex-compact 🚀 34372105 38387361 0.90
tpcds_q61/duckdb:vortex-compact 53735068 53796849 1.00
tpcds_q62/duckdb:vortex-compact 21519661 21159771 1.02
tpcds_q63/duckdb:vortex-compact 33152866 31967056 1.04
tpcds_q64/duckdb:vortex-compact 125753726 134451501 0.94
tpcds_q65/duckdb:vortex-compact 🚨 33582700 30046811 1.12
tpcds_q66/duckdb:vortex-compact 36772412 35357180 1.04
tpcds_q67/duckdb:vortex-compact 150852028 151982876 0.99
tpcds_q68/duckdb:vortex-compact 45777166 48226809 0.95
tpcds_q69/duckdb:vortex-compact 55751053 54493049 1.02
tpcds_q70/duckdb:vortex-compact 59284639 58053362 1.02
tpcds_q71/duckdb:vortex-compact 30202477 29306804 1.03
tpcds_q72/duckdb:vortex-compact 186079080 182421770 1.02
tpcds_q73/duckdb:vortex-compact 28442156 27831210 1.02
tpcds_q74/duckdb:vortex-compact 50876057 48194778 1.06
tpcds_q75/duckdb:vortex-compact 63124441 63683405 0.99
tpcds_q76/duckdb:vortex-compact 29106815 28934686 1.01
tpcds_q77/duckdb:vortex-compact 39486147 36654672 1.08
tpcds_q78/duckdb:vortex-compact 90714391 88079720 1.03
tpcds_q79/duckdb:vortex-compact 42713336 42687882 1.00
tpcds_q80/duckdb:vortex-compact 70833306 68636047 1.03
tpcds_q81/duckdb:vortex-compact 33896729 32854897 1.03
tpcds_q82/duckdb:vortex-compact 50419030 51268384 0.98
tpcds_q83/duckdb:vortex-compact 36976705 34183365 1.08
tpcds_q84/duckdb:vortex-compact 🚀 21418728 27804846 0.77
tpcds_q85/duckdb:vortex-compact 55631129 59765096 0.93
tpcds_q86/duckdb:vortex-compact 22236823 21138586 1.05
tpcds_q87/duckdb:vortex-compact 44913692 44981852 1.00
tpcds_q88/duckdb:vortex-compact 78044747 75545091 1.03
tpcds_q89/duckdb:vortex-compact 33285432 32330995 1.03
tpcds_q90/duckdb:vortex-compact 11170160 11147793 1.00
tpcds_q91/duckdb:vortex-compact 42350617 43044954 0.98
tpcds_q92/duckdb:vortex-compact 44129606 46866217 0.94
tpcds_q93/duckdb:vortex-compact 32671608 33130399 0.99
tpcds_q94/duckdb:vortex-compact 28428503 26833015 1.06
tpcds_q95/duckdb:vortex-compact 175157931 161915824 1.08
tpcds_q96/duckdb:vortex-compact 16157372 16095360 1.00
tpcds_q97/duckdb:vortex-compact 41133593 42824752 0.96
tpcds_q98/duckdb:vortex-compact 28308273 26747337 1.06
tpcds_q99/duckdb:vortex-compact 30706966 28355952 1.08
duckdb / parquet (1.017x ➖, 0↑ 2↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30667548 29442668 1.04
tpcds_q02/duckdb:parquet 24022345 24003647 1.00
tpcds_q03/duckdb:parquet 13199104 12473772 1.06
tpcds_q04/duckdb:parquet 168712767 164158160 1.03
tpcds_q05/duckdb:parquet 31532535 31549105 1.00
tpcds_q06/duckdb:parquet 34010203 33119249 1.03
tpcds_q07/duckdb:parquet 24456807 24172457 1.01
tpcds_q08/duckdb:parquet 29870525 28916557 1.03
tpcds_q09/duckdb:parquet 44244950 44107129 1.00
tpcds_q10/duckdb:parquet 37961921 37207634 1.02
tpcds_q11/duckdb:parquet 94694454 92178184 1.03
tpcds_q12/duckdb:parquet 17420160 17205079 1.01
tpcds_q13/duckdb:parquet 35341288 35056995 1.01
tpcds_q14/duckdb:parquet 99158618 103002269 0.96
tpcds_q15/duckdb:parquet 31342200 30242728 1.04
tpcds_q16/duckdb:parquet 23053091 22469483 1.03
tpcds_q17/duckdb:parquet 40961169 38700659 1.06
tpcds_q18/duckdb:parquet 48889737 48121363 1.02
tpcds_q19/duckdb:parquet 31865408 31619623 1.01
tpcds_q20/duckdb:parquet 19151728 18454833 1.04
tpcds_q21/duckdb:parquet 11821938 11497502 1.03
tpcds_q22/duckdb:parquet 66082453 70376459 0.94
tpcds_q23/duckdb:parquet 83030625 81399881 1.02
tpcds_q24/duckdb:parquet 47417559 46715312 1.02
tpcds_q25/duckdb:parquet 35701823 35408703 1.01
tpcds_q26/duckdb:parquet 39824275 39704602 1.00
tpcds_q27/duckdb:parquet 53677240 52961891 1.01
tpcds_q28/duckdb:parquet 42364756 42803649 0.99
tpcds_q29/duckdb:parquet 37413111 36518996 1.02
tpcds_q30/duckdb:parquet 37977816 37619162 1.01
tpcds_q31/duckdb:parquet 27474123 28421467 0.97
tpcds_q32/duckdb:parquet 12770228 12539850 1.02
tpcds_q33/duckdb:parquet 25141710 23098331 1.09
tpcds_q34/duckdb:parquet 23074305 21853633 1.06
tpcds_q35/duckdb:parquet 61052946 59932466 1.02
tpcds_q36/duckdb:parquet 22436958 22940719 0.98
tpcds_q37/duckdb:parquet 14597179 14157022 1.03
tpcds_q38/duckdb:parquet 37313877 36531525 1.02
tpcds_q39/duckdb:parquet 32509557 32307476 1.01
tpcds_q40/duckdb:parquet 20370422 19483405 1.05
tpcds_q41/duckdb:parquet 8970744 8724997 1.03
tpcds_q42/duckdb:parquet 13300641 12940491 1.03
tpcds_q43/duckdb:parquet 18529020 17508250 1.06
tpcds_q44/duckdb:parquet 25925720 26168087 0.99
tpcds_q45/duckdb:parquet 30019419 29897735 1.00
tpcds_q46/duckdb:parquet 48805853 47328232 1.03
tpcds_q47/duckdb:parquet 51035937 50115565 1.02
tpcds_q48/duckdb:parquet 32697658 32215833 1.01
tpcds_q49/duckdb:parquet 27620003 28447300 0.97
tpcds_q50/duckdb:parquet 26111773 26515178 0.98
tpcds_q51/duckdb:parquet 104769365 104255507 1.00
tpcds_q52/duckdb:parquet 13261773 12607508 1.05
tpcds_q53/duckdb:parquet 19372086 19442172 1.00
tpcds_q54/duckdb:parquet 29395008 29185323 1.01
tpcds_q55/duckdb:parquet 13009386 12666667 1.03
tpcds_q56/duckdb:parquet 25013192 24330707 1.03
tpcds_q57/duckdb:parquet 38110878 38066667 1.00
tpcds_q58/duckdb:parquet 25623073 26489295 0.97
tpcds_q59/duckdb:parquet 36359165 36376524 1.00
tpcds_q60/duckdb:parquet 25896833 24862536 1.04
tpcds_q61/duckdb:parquet 33995705 34510049 0.99
tpcds_q62/duckdb:parquet 12823967 12794084 1.00
tpcds_q63/duckdb:parquet 17894074 17744410 1.01
tpcds_q64/duckdb:parquet 80594763 81680321 0.99
tpcds_q65/duckdb:parquet 22997650 23236815 0.99
tpcds_q66/duckdb:parquet 29655717 29314710 1.01
tpcds_q67/duckdb:parquet 139012465 137451300 1.01
tpcds_q68/duckdb:parquet 38769177 38887596 1.00
tpcds_q69/duckdb:parquet 38745276 37968164 1.02
tpcds_q70/duckdb:parquet 23073487 22111409 1.04
tpcds_q71/duckdb:parquet 23828140 22218330 1.07
tpcds_q72/duckdb:parquet 168057643 167156129 1.01
tpcds_q73/duckdb:parquet 🚨 21202519 19128275 1.11
tpcds_q74/duckdb:parquet 127633114 128480369 0.99
tpcds_q75/duckdb:parquet 59168922 55953719 1.06
tpcds_q76/duckdb:parquet 22132663 21623216 1.02
tpcds_q77/duckdb:parquet 26012069 24937825 1.04
tpcds_q78/duckdb:parquet 77081444 76905899 1.00
tpcds_q79/duckdb:parquet 30876365 30648592 1.01
tpcds_q80/duckdb:parquet 44338467 43669131 1.02
tpcds_q81/duckdb:parquet 35193790 35307107 1.00
tpcds_q82/duckdb:parquet 16215366 17041085 0.95
tpcds_q83/duckdb:parquet 18594692 18337566 1.01
tpcds_q84/duckdb:parquet 20762679 20403442 1.02
tpcds_q85/duckdb:parquet 42003873 42028452 1.00
tpcds_q86/duckdb:parquet 13754030 13655865 1.01
tpcds_q87/duckdb:parquet 39268906 39315551 1.00
tpcds_q88/duckdb:parquet 54263674 52834209 1.03
tpcds_q89/duckdb:parquet 22187719 21660199 1.02
tpcds_q90/duckdb:parquet 8686154 8333636 1.04
tpcds_q91/duckdb:parquet 25460961 25116779 1.01
tpcds_q92/duckdb:parquet 13419316 13048854 1.03
tpcds_q93/duckdb:parquet 32763123 31980105 1.02
tpcds_q94/duckdb:parquet 18384446 17671764 1.04
tpcds_q95/duckdb:parquet 🚨 145481477 119874067 1.21
tpcds_q96/duckdb:parquet 10697928 10790247 0.99
tpcds_q97/duckdb:parquet 38910385 39421465 0.99
tpcds_q98/duckdb:parquet 24670772 24004558 1.03
tpcds_q99/duckdb:parquet 20456471 19917168 1.03
duckdb / duckdb (1.011x ➖, 0↑ 2↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22465221 22531523 1.00
tpcds_q02/duckdb:duckdb 18819752 20520736 0.92
tpcds_q03/duckdb:duckdb 10460416 10457890 1.00
tpcds_q04/duckdb:duckdb 179451733 177321420 1.01
tpcds_q05/duckdb:duckdb 22392794 22095131 1.01
tpcds_q06/duckdb:duckdb 28504563 28058111 1.02
tpcds_q07/duckdb:duckdb 40881593 40205994 1.02
tpcds_q08/duckdb:duckdb 120062623 120133408 1.00
tpcds_q09/duckdb:duckdb 21132996 20833074 1.01
tpcds_q10/duckdb:duckdb 27624624 28062482 0.98
tpcds_q11/duckdb:duckdb 95035047 90357088 1.05
tpcds_q12/duckdb:duckdb 14206293 13860172 1.02
tpcds_q13/duckdb:duckdb 26239463 26362562 1.00
tpcds_q14/duckdb:duckdb 95285173 94876494 1.00
tpcds_q15/duckdb:duckdb 25013403 24744901 1.01
tpcds_q16/duckdb:duckdb 19335255 21017508 0.92
tpcds_q17/duckdb:duckdb 25660959 25658969 1.00
tpcds_q18/duckdb:duckdb 48066018 47081485 1.02
tpcds_q19/duckdb:duckdb 20158217 19238125 1.05
tpcds_q20/duckdb:duckdb 14614879 14206863 1.03
tpcds_q21/duckdb:duckdb 7519824 7560917 0.99
tpcds_q22/duckdb:duckdb 63165921 67085388 0.94
tpcds_q23/duckdb:duckdb 80442350 75887275 1.06
tpcds_q24/duckdb:duckdb 25546114 25524952 1.00
tpcds_q25/duckdb:duckdb 19030953 18968096 1.00
tpcds_q26/duckdb:duckdb 28991011 28660902 1.01
tpcds_q27/duckdb:duckdb 42681761 41483112 1.03
tpcds_q28/duckdb:duckdb 27015132 26663250 1.01
tpcds_q29/duckdb:duckdb 23979261 24118035 0.99
tpcds_q30/duckdb:duckdb 31174959 31017776 1.01
tpcds_q31/duckdb:duckdb 52862251 51733491 1.02
tpcds_q32/duckdb:duckdb 8616925 7979703 1.08
tpcds_q33/duckdb:duckdb 17040927 16749167 1.02
tpcds_q34/duckdb:duckdb 18914679 18797052 1.01
tpcds_q35/duckdb:duckdb 37792647 36963748 1.02
tpcds_q36/duckdb:duckdb 72612703 72264878 1.00
tpcds_q37/duckdb:duckdb 9070720 8918532 1.02
tpcds_q38/duckdb:duckdb 33804229 33382412 1.01
tpcds_q39/duckdb:duckdb 29073902 28064581 1.04
tpcds_q40/duckdb:duckdb 15109067 14575947 1.04
tpcds_q41/duckdb:duckdb 9669423 9247320 1.05
tpcds_q42/duckdb:duckdb 9129768 8915790 1.02
tpcds_q43/duckdb:duckdb 14582643 14939008 0.98
tpcds_q44/duckdb:duckdb 15632370 15426653 1.01
tpcds_q45/duckdb:duckdb 19330693 18673568 1.04
tpcds_q46/duckdb:duckdb 39804848 38477002 1.03
tpcds_q47/duckdb:duckdb 46919323 45728532 1.03
tpcds_q48/duckdb:duckdb 25282553 25220437 1.00
tpcds_q49/duckdb:duckdb 22074687 20486764 1.08
tpcds_q50/duckdb:duckdb 16548536 15972622 1.04
tpcds_q51/duckdb:duckdb 101942484 99541863 1.02
tpcds_q52/duckdb:duckdb 9682003 10295473 0.94
tpcds_q53/duckdb:duckdb 17778762 17616636 1.01
tpcds_q54/duckdb:duckdb 19200259 18727190 1.03
tpcds_q55/duckdb:duckdb 9427048 10223311 0.92
tpcds_q56/duckdb:duckdb 16719933 17179927 0.97
tpcds_q57/duckdb:duckdb 36694237 36418403 1.01
tpcds_q58/duckdb:duckdb 16789811 18043752 0.93
tpcds_q59/duckdb:duckdb 37018129 36814250 1.01
tpcds_q60/duckdb:duckdb 18547622 19188219 0.97
tpcds_q61/duckdb:duckdb 16748605 16294717 1.03
tpcds_q62/duckdb:duckdb 10093875 9794856 1.03
tpcds_q63/duckdb:duckdb 16627262 15778575 1.05
tpcds_q64/duckdb:duckdb 58152449 59535140 0.98
tpcds_q65/duckdb:duckdb 36763765 36404363 1.01
tpcds_q66/duckdb:duckdb 26419534 26263265 1.01
tpcds_q67/duckdb:duckdb 136187692 135963074 1.00
tpcds_q68/duckdb:duckdb 27617936 26791890 1.03
tpcds_q69/duckdb:duckdb 28665836 27471210 1.04
tpcds_q70/duckdb:duckdb 16657756 16609049 1.00
tpcds_q71/duckdb:duckdb 16026820 17642742 0.91
tpcds_q72/duckdb:duckdb 46612437 45980057 1.01
tpcds_q73/duckdb:duckdb 14676751 14203262 1.03
tpcds_q74/duckdb:duckdb 147033273 146548817 1.00
tpcds_q75/duckdb:duckdb 46727843 46754164 1.00
tpcds_q76/duckdb:duckdb 14442773 14483260 1.00
tpcds_q77/duckdb:duckdb 16174879 15646644 1.03
tpcds_q78/duckdb:duckdb 66014127 66090098 1.00
tpcds_q79/duckdb:duckdb 20226613 20117957 1.01
tpcds_q80/duckdb:duckdb 32391809 31304271 1.03
tpcds_q81/duckdb:duckdb 40026385 40119021 1.00
tpcds_q82/duckdb:duckdb 10368734 10377969 1.00
tpcds_q83/duckdb:duckdb 11111726 10880534 1.02
tpcds_q84/duckdb:duckdb 15207764 14312982 1.06
tpcds_q85/duckdb:duckdb 26053503 25673215 1.01
tpcds_q86/duckdb:duckdb 12242775 12112904 1.01
tpcds_q87/duckdb:duckdb 36071683 35293198 1.02
tpcds_q88/duckdb:duckdb 30308665 30408761 1.00
tpcds_q89/duckdb:duckdb 21971154 22712791 0.97
tpcds_q90/duckdb:duckdb 6552477 6119457 1.07
tpcds_q91/duckdb:duckdb 🚨 16091074 14403110 1.12
tpcds_q92/duckdb:duckdb 10184372 9823215 1.04
tpcds_q93/duckdb:duckdb 24137611 23652039 1.02
tpcds_q94/duckdb:duckdb 14582629 14600814 1.00
tpcds_q95/duckdb:duckdb 🚨 130469117 116503665 1.12
tpcds_q96/duckdb:duckdb 5994389 6133828 0.98
tpcds_q97/duckdb:duckdb 32451546 32109379 1.01
tpcds_q98/duckdb:duckdb 20712097 20769898 1.00
tpcds_q99/duckdb:duckdb 17007970 16853563 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.7% +2.4% +0.3% +20.9% ➖ noise
1 datafusion:vortex-file-compressed -2.7% +2.4% -5.0% +20.6% ➖ noise
1 duckdb:duckdb -0.3% +2.4% -2.6% +18.8% ➖ noise
1 duckdb:vortex-compact +8.5% +2.4% +6.0% +20.0% ➖ noise
1 duckdb:vortex-file-compressed -11.5% +2.4% -13.5% +28.1% ➖ noise
2 datafusion:vortex-compact +5.3% -1.5% +6.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.1% -1.5% +0.4% +10.0% ➖ noise
2 duckdb:duckdb -8.3% -1.5% -6.9% +10.0% ➖ noise
2 duckdb:vortex-compact +22.6% -1.5% +24.5% +34.3% ➖ noise
2 duckdb:vortex-file-compressed +7.3% -1.5% +8.9% +23.7% ➖ noise
3 datafusion:vortex-compact +0.8% +1.6% -0.8% +15.0% ➖ noise
3 datafusion:vortex-file-compressed +0.1% +1.6% -1.5% +10.1% ➖ noise
3 duckdb:duckdb +0.0% +1.6% -1.5% +10.0% ➖ noise
3 duckdb:vortex-compact -0.6% +1.6% -2.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.5% +1.6% -1.1% +10.0% ➖ noise
4 datafusion:vortex-compact +6.3% -2.0% +8.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +5.0% -2.0% +7.1% +10.0% ➖ noise
4 duckdb:duckdb +1.2% -2.0% +3.2% +10.0% ➖ noise
4 duckdb:vortex-compact -2.2% -2.0% -0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.4% -2.0% +0.5% +10.0% ➖ noise
5 datafusion:vortex-compact +4.7% -1.3% +6.1% +13.9% ➖ noise
5 datafusion:vortex-file-compressed +3.9% -1.3% +5.3% +10.3% ➖ noise
5 duckdb:duckdb +1.3% -1.3% +2.7% +12.6% ➖ noise
5 duckdb:vortex-compact +1.9% -1.3% +3.3% +16.2% ➖ noise
5 duckdb:vortex-file-compressed +1.3% -1.3% +2.7% +13.1% ➖ noise
6 datafusion:vortex-compact +4.9% +1.7% +3.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.1% +1.7% -0.6% +10.0% ➖ noise
6 duckdb:duckdb +1.6% +1.7% -0.1% +10.0% ➖ noise
6 duckdb:vortex-compact +1.8% +1.7% +0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.9% +1.7% -0.8% +10.0% ➖ noise
7 datafusion:vortex-compact -0.2% +2.3% -2.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.4% +2.3% -0.9% +10.0% ➖ noise
7 duckdb:duckdb +1.7% +2.3% -0.6% +10.0% ➖ noise
7 duckdb:vortex-compact +4.4% +2.3% +2.1% +19.5% ➖ noise
7 duckdb:vortex-file-compressed +0.4% +2.3% -1.8% +10.0% ➖ noise
8 datafusion:vortex-compact -0.9% +3.9% -4.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +12.6% +3.9% +8.3% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +3.9% -3.8% +10.0% ➖ noise
8 duckdb:vortex-compact -0.7% +3.9% -4.4% +15.3% ➖ noise
8 duckdb:vortex-file-compressed +9.7% +3.9% +5.6% +21.7% ➖ noise
9 datafusion:vortex-compact -1.1% +0.6% -1.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +12.5% +0.6% +11.8% +10.0% 🚨 regression
9 duckdb:duckdb +1.4% +0.6% +0.8% +10.0% ➖ noise
9 duckdb:vortex-compact -5.4% +0.6% -6.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.0% +0.6% -1.6% +14.3% ➖ noise
10 datafusion:vortex-compact +2.2% +5.5% -3.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.8% +5.5% -1.6% +10.0% ➖ noise
10 duckdb:duckdb -1.6% +5.5% -6.7% +10.0% ➖ noise
10 duckdb:vortex-compact +4.4% +5.5% -1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.5% +5.5% -3.8% +10.0% ➖ noise
11 datafusion:vortex-compact +3.0% +1.1% +1.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.4% +1.1% +1.3% +10.0% ➖ noise
11 duckdb:duckdb +5.2% +1.1% +4.0% +10.0% ➖ noise
11 duckdb:vortex-compact +5.9% +1.1% +4.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.2% +1.1% +0.1% +10.0% ➖ noise
12 datafusion:vortex-compact +2.2% -0.0% +2.2% +13.8% ➖ noise
12 datafusion:vortex-file-compressed +2.8% -0.0% +2.8% +10.0% ➖ noise
12 duckdb:duckdb +2.5% -0.0% +2.5% +10.0% ➖ noise
12 duckdb:vortex-compact +1.1% -0.0% +1.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +5.2% -0.0% +5.2% +10.5% ➖ noise
13 datafusion:vortex-compact +7.6% +2.0% +5.5% +18.3% ➖ noise
13 datafusion:vortex-file-compressed +20.1% +2.0% +17.7% +10.0% 🚨 regression
13 duckdb:duckdb -0.5% +2.0% -2.4% +10.0% ➖ noise
13 duckdb:vortex-compact +2.6% +2.0% +0.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.5% +2.0% -1.5% +11.8% ➖ noise
14 datafusion:vortex-compact +3.4% -3.3% +6.9% +10.7% ➖ noise
14 datafusion:vortex-file-compressed +2.1% -3.3% +5.6% +10.0% ➖ noise
14 duckdb:duckdb +0.4% -3.3% +3.9% +10.0% ➖ noise
14 duckdb:vortex-compact +5.5% -3.3% +9.1% +10.4% ➖ noise
14 duckdb:vortex-file-compressed +1.4% -3.3% +4.9% +10.0% ➖ noise
15 datafusion:vortex-compact +1.6% +0.3% +1.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -2.3% +0.3% -2.6% +10.0% ➖ noise
15 duckdb:duckdb +1.1% +0.3% +0.8% +10.1% ➖ noise
15 duckdb:vortex-compact -0.9% +0.3% -1.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.7% +0.3% +3.5% +15.8% ➖ noise
16 datafusion:vortex-compact +2.5% +1.7% +0.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.0% +1.7% +0.4% +15.9% ➖ noise
16 duckdb:duckdb -8.0% +1.7% -9.5% +10.7% ➖ noise
16 duckdb:vortex-compact +7.7% +1.7% +5.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +3.5% +1.7% +1.8% +10.1% ➖ noise
17 datafusion:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +4.7% +1.6% +3.0% +10.0% ➖ noise
17 duckdb:duckdb +0.0% +1.6% -1.6% +10.8% ➖ noise
17 duckdb:vortex-compact +5.7% +1.6% +4.0% +14.1% ➖ noise
17 duckdb:vortex-file-compressed -1.3% +1.6% -2.8% +10.0% ➖ noise
18 datafusion:vortex-compact +1.9% +1.6% +0.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.9% +1.6% +2.3% +10.0% ➖ noise
18 duckdb:duckdb +2.1% +1.6% +0.5% +10.0% ➖ noise
18 duckdb:vortex-compact +1.9% +1.6% +0.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.9% +1.6% +0.3% +10.0% ➖ noise
19 datafusion:vortex-compact +1.3% +0.1% +1.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +3.2% +0.1% +3.1% +10.0% ➖ noise
19 duckdb:duckdb +4.8% +0.1% +4.7% +10.0% ➖ noise
19 duckdb:vortex-compact +3.5% +0.1% +3.4% +13.8% ➖ noise
19 duckdb:vortex-file-compressed +2.5% +0.1% +2.4% +10.1% ➖ noise
20 datafusion:vortex-compact +5.9% +1.7% +4.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -3.7% +1.7% -5.3% +15.8% ➖ noise
20 duckdb:duckdb +2.9% +1.7% +1.2% +10.0% ➖ noise
20 duckdb:vortex-compact +2.5% +1.7% +0.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +4.7% +1.7% +2.9% +10.0% ➖ noise
21 datafusion:vortex-compact +4.3% -0.9% +5.3% +12.1% ➖ noise
21 datafusion:vortex-file-compressed -1.4% -0.9% -0.5% +10.0% ➖ noise
21 duckdb:duckdb -0.5% -0.9% +0.4% +17.3% ➖ noise
21 duckdb:vortex-compact +3.9% -0.9% +4.8% +15.4% ➖ noise
21 duckdb:vortex-file-compressed +0.0% -0.9% +1.0% +15.3% ➖ noise
22 datafusion:vortex-compact +6.2% +6.3% -0.0% +20.1% ➖ noise
22 datafusion:vortex-file-compressed +0.6% +6.3% -5.4% +29.0% ➖ noise
22 duckdb:duckdb -5.8% +6.3% -11.4% +15.2% ➖ noise
22 duckdb:vortex-compact +1.1% +6.3% -4.8% +12.5% ➖ noise
22 duckdb:vortex-file-compressed +0.7% +6.3% -5.3% +13.6% ➖ noise
23 datafusion:vortex-compact +3.4% -0.3% +3.8% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +2.9% -0.3% +3.2% +10.0% ➖ noise
23 duckdb:duckdb +6.0% -0.3% +6.3% +10.0% ➖ noise
23 duckdb:vortex-compact -12.9% -0.3% -12.6% +23.7% ➖ noise
23 duckdb:vortex-file-compressed -7.8% -0.3% -7.5% +14.9% ➖ noise
24 datafusion:vortex-compact -6.7% +1.6% -8.2% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +0.7% +1.6% -0.9% +10.0% ➖ noise
24 duckdb:duckdb +0.1% +1.6% -1.5% +10.0% ➖ noise
24 duckdb:vortex-compact +4.0% +1.6% +2.4% +12.7% ➖ noise
24 duckdb:vortex-file-compressed +2.8% +1.6% +1.2% +10.0% ➖ noise
25 datafusion:vortex-compact +2.7% +0.6% +2.1% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +0.7% +0.6% +0.0% +10.0% ➖ noise
25 duckdb:duckdb +0.3% +0.6% -0.3% +10.0% ➖ noise
25 duckdb:vortex-compact -28.4% +0.6% -28.8% +10.0% ✅ faster
25 duckdb:vortex-file-compressed -16.2% +0.6% -16.7% +19.9% ✅ faster
26 datafusion:vortex-compact +4.2% -0.1% +4.4% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +2.4% -0.1% +2.6% +13.4% ➖ noise
26 duckdb:duckdb +1.2% -0.1% +1.3% +10.0% ➖ noise
26 duckdb:vortex-compact +4.0% -0.1% +4.1% +10.5% ➖ noise
26 duckdb:vortex-file-compressed -2.7% -0.1% -2.5% +10.0% ➖ noise
27 datafusion:vortex-compact +0.9% +2.0% -1.1% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +1.7% +2.0% -0.3% +14.6% ➖ noise
27 duckdb:duckdb +2.9% +2.0% +0.9% +10.0% ➖ noise
27 duckdb:vortex-compact +5.7% +2.0% +3.6% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +2.4% +2.0% +0.4% +10.0% ➖ noise
28 datafusion:vortex-compact +7.9% -0.9% +8.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.2% -0.9% +1.1% +10.8% ➖ noise
28 duckdb:duckdb +1.3% -0.9% +2.2% +10.0% ➖ noise
28 duckdb:vortex-compact +3.7% -0.9% +4.6% +28.4% ➖ noise
28 duckdb:vortex-file-compressed +0.8% -0.9% +1.7% +10.0% ➖ noise
29 datafusion:vortex-compact +1.7% +0.6% +1.1% +10.4% ➖ noise
29 datafusion:vortex-file-compressed +3.5% +0.6% +2.8% +10.0% ➖ noise
29 duckdb:duckdb -0.6% +0.6% -1.2% +10.0% ➖ noise
29 duckdb:vortex-compact -0.1% +0.6% -0.7% +13.9% ➖ noise
29 duckdb:vortex-file-compressed -5.1% +0.6% -5.7% +10.0% ➖ noise
30 datafusion:vortex-compact +9.8% +2.5% +7.1% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +3.7% +2.5% +1.2% +10.0% ➖ noise
30 duckdb:duckdb +0.5% +2.5% -1.9% +10.0% ➖ noise
30 duckdb:vortex-compact -1.9% +2.5% -4.2% +14.3% ➖ noise
30 duckdb:vortex-file-compressed +3.0% +2.5% +0.5% +10.0% ➖ noise
31 datafusion:vortex-compact -0.0% -0.9% +0.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.2% -0.9% -1.4% +10.0% ➖ noise
31 duckdb:duckdb +2.2% -0.9% +3.1% +10.0% ➖ noise
31 duckdb:vortex-compact +7.6% -0.9% +8.6% +13.3% ➖ noise
31 duckdb:vortex-file-compressed +3.7% -0.9% +4.7% +11.2% ➖ noise
32 datafusion:vortex-compact +0.3% +1.6% -1.2% +12.4% ➖ noise
32 datafusion:vortex-file-compressed +3.2% +1.6% +1.6% +10.0% ➖ noise
32 duckdb:duckdb +8.0% +1.6% +6.3% +10.8% ➖ noise
32 duckdb:vortex-compact +6.4% +1.6% +4.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +2.5% +1.6% +0.9% +10.0% ➖ noise
33 datafusion:vortex-compact -2.0% +1.5% -3.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.1% +1.5% -0.5% +10.0% ➖ noise
33 duckdb:duckdb +1.7% +1.5% +0.2% +13.0% ➖ noise
33 duckdb:vortex-compact +2.6% +1.5% +1.0% +15.7% ➖ noise
33 duckdb:vortex-file-compressed +7.1% +1.5% +5.5% +10.0% ➖ noise
34 datafusion:vortex-compact +2.1% +2.4% -0.3% +12.8% ➖ noise
34 datafusion:vortex-file-compressed +4.2% +2.4% +1.8% +16.3% ➖ noise
34 duckdb:duckdb +0.6% +2.4% -1.7% +10.0% ➖ noise
34 duckdb:vortex-compact +3.4% +2.4% +1.0% +11.1% ➖ noise
34 duckdb:vortex-file-compressed +0.6% +2.4% -1.8% +11.0% ➖ noise
35 datafusion:vortex-compact +2.8% +1.6% +1.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.4% +1.6% +0.8% +10.0% ➖ noise
35 duckdb:duckdb +2.2% +1.6% +0.6% +10.0% ➖ noise
35 duckdb:vortex-compact +5.8% +1.6% +4.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.5% +1.6% -3.1% +10.0% ➖ noise
36 datafusion:vortex-compact +1.5% +0.2% +1.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.6% +0.2% +1.4% +10.0% ➖ noise
36 duckdb:duckdb +0.5% +0.2% +0.3% +10.0% ➖ noise
36 duckdb:vortex-compact -0.2% +0.2% -0.4% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -3.6% +0.2% -3.8% +10.0% ➖ noise
37 datafusion:vortex-compact +5.9% +5.0% +0.9% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +5.4% +5.0% +0.4% +10.0% ➖ noise
37 duckdb:duckdb +1.7% +5.0% -3.2% +10.0% ➖ noise
37 duckdb:vortex-compact +3.3% +5.0% -1.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +3.6% +5.0% -1.3% +10.0% ➖ noise
38 datafusion:vortex-compact +5.5% +3.3% +2.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +3.7% +3.3% +0.4% +10.0% ➖ noise
38 duckdb:duckdb +1.3% +3.3% -2.0% +10.0% ➖ noise
38 duckdb:vortex-compact +3.0% +3.3% -0.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +1.3% +3.3% -2.0% +10.0% ➖ noise
39 datafusion:vortex-compact +0.9% +0.1% +0.7% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +2.9% +0.1% +2.8% +10.0% ➖ noise
39 duckdb:duckdb +3.6% +0.1% +3.5% +19.7% ➖ noise
39 duckdb:vortex-compact +6.4% +0.1% +6.3% +12.6% ➖ noise
39 duckdb:vortex-file-compressed +0.2% +0.1% +0.1% +21.4% ➖ noise
40 datafusion:vortex-compact -0.8% +1.7% -2.4% +12.3% ➖ noise
40 datafusion:vortex-file-compressed +1.6% +1.7% -0.1% +12.0% ➖ noise
40 duckdb:duckdb +3.7% +1.7% +1.9% +10.0% ➖ noise
40 duckdb:vortex-compact +0.5% +1.7% -1.2% +15.3% ➖ noise
40 duckdb:vortex-file-compressed +4.4% +1.7% +2.6% +10.0% ➖ noise
41 datafusion:vortex-compact +4.1% +3.4% +0.6% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +7.9% +3.4% +4.3% +10.0% ➖ noise
41 duckdb:duckdb +4.6% +3.4% +1.1% +10.0% ➖ noise
41 duckdb:vortex-compact +3.6% +3.4% +0.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.1% +3.4% -3.2% +10.0% ➖ noise
42 datafusion:vortex-compact +3.3% +0.7% +2.7% +11.5% ➖ noise
42 datafusion:vortex-file-compressed -0.1% +0.7% -0.7% +12.2% ➖ noise
42 duckdb:duckdb +2.4% +0.7% +1.7% +14.4% ➖ noise
42 duckdb:vortex-compact +1.5% +0.7% +0.9% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -1.6% +0.7% -2.2% +12.2% ➖ noise
43 datafusion:vortex-compact +0.7% +4.8% -4.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +4.1% +4.8% -0.7% +11.4% ➖ noise
43 duckdb:duckdb -2.4% +4.8% -6.9% +10.0% ➖ noise
43 duckdb:vortex-compact -0.1% +4.8% -4.6% +25.9% ➖ noise
43 duckdb:vortex-file-compressed -4.5% +4.8% -8.9% +25.5% ➖ noise
44 datafusion:vortex-compact +0.6% +0.4% +0.2% +14.2% ➖ noise
44 datafusion:vortex-file-compressed -0.0% +0.4% -0.4% +10.0% ➖ noise
44 duckdb:duckdb +1.3% +0.4% +1.0% +10.0% ➖ noise
44 duckdb:vortex-compact +4.6% +0.4% +4.3% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +4.0% +0.4% +3.7% +18.8% ➖ noise
45 datafusion:vortex-compact -0.5% +3.5% -3.9% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +2.3% +3.5% -1.2% +10.0% ➖ noise
45 duckdb:duckdb +3.5% +3.5% +0.0% +10.0% ➖ noise
45 duckdb:vortex-compact +1.1% +3.5% -2.4% +10.4% ➖ noise
45 duckdb:vortex-file-compressed +5.5% +3.5% +1.9% +10.0% ➖ noise
46 datafusion:vortex-compact -1.4% +3.2% -4.4% +10.3% ➖ noise
46 datafusion:vortex-file-compressed -0.6% +3.2% -3.7% +10.0% ➖ noise
46 duckdb:duckdb +3.5% +3.2% +0.3% +10.0% ➖ noise
46 duckdb:vortex-compact -1.1% +3.2% -4.2% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -4.1% +3.2% -7.1% +10.0% ➖ noise
47 datafusion:vortex-compact +2.6% +1.3% +1.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +2.9% +1.3% +1.6% +10.0% ➖ noise
47 duckdb:duckdb +2.6% +1.3% +1.3% +10.0% ➖ noise
47 duckdb:vortex-compact +1.3% +1.3% +0.0% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +1.3% +1.3% +0.0% +10.0% ➖ noise
48 datafusion:vortex-compact +5.0% +1.3% +3.6% +20.1% ➖ noise
48 datafusion:vortex-file-compressed +5.5% +1.3% +4.1% +10.0% ➖ noise
48 duckdb:duckdb +0.2% +1.3% -1.0% +10.0% ➖ noise
48 duckdb:vortex-compact +1.5% +1.3% +0.2% +12.1% ➖ noise
48 duckdb:vortex-file-compressed +2.4% +1.3% +1.1% +17.5% ➖ noise
49 datafusion:vortex-compact +2.0% -0.7% +2.7% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +1.6% -0.7% +2.3% +10.0% ➖ noise
49 duckdb:duckdb +7.8% -0.7% +8.5% +10.0% ➖ noise
49 duckdb:vortex-compact -1.2% -0.7% -0.5% +12.8% ➖ noise
49 duckdb:vortex-file-compressed +3.2% -0.7% +3.9% +12.8% ➖ noise
50 datafusion:vortex-compact +1.1% -0.8% +1.9% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +4.8% -0.8% +5.7% +10.0% ➖ noise
50 duckdb:duckdb +3.6% -0.8% +4.5% +10.0% ➖ noise
50 duckdb:vortex-compact +9.3% -0.8% +10.2% +10.6% ➖ noise
50 duckdb:vortex-file-compressed -11.6% -0.8% -10.8% +10.0% ✅ faster
51 datafusion:vortex-compact -0.7% -0.0% -0.7% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +3.5% -0.0% +3.6% +10.0% ➖ noise
51 duckdb:duckdb +2.4% -0.0% +2.4% +15.2% ➖ noise
51 duckdb:vortex-compact +1.1% -0.0% +1.2% +15.4% ➖ noise
51 duckdb:vortex-file-compressed -0.9% -0.0% -0.8% +16.2% ➖ noise
52 datafusion:vortex-compact +1.5% +4.0% -2.5% +11.2% ➖ noise
52 datafusion:vortex-file-compressed +8.4% +4.0% +4.2% +10.0% ➖ noise
52 duckdb:duckdb -6.0% +4.0% -9.6% +14.8% ➖ noise
52 duckdb:vortex-compact +13.4% +4.0% +9.0% +13.7% ➖ noise
52 duckdb:vortex-file-compressed +2.1% +4.0% -1.8% +12.5% ➖ noise
53 datafusion:vortex-compact +1.3% +0.1% +1.2% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +2.6% +0.1% +2.5% +10.0% ➖ noise
53 duckdb:duckdb +0.9% +0.1% +0.8% +10.0% ➖ noise
53 duckdb:vortex-compact +3.2% +0.1% +3.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +2.9% +0.1% +2.8% +10.0% ➖ noise
54 datafusion:vortex-compact +0.3% +0.5% -0.2% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +2.4% +0.5% +1.9% +10.0% ➖ noise
54 duckdb:duckdb +2.5% +0.5% +2.0% +10.0% ➖ noise
54 duckdb:vortex-compact -2.2% +0.5% -2.7% +10.7% ➖ noise
54 duckdb:vortex-file-compressed +3.9% +0.5% +3.4% +13.8% ➖ noise
55 datafusion:vortex-compact -3.5% +1.2% -4.7% +11.4% ➖ noise
55 datafusion:vortex-file-compressed -2.0% +1.2% -3.2% +14.2% ➖ noise
55 duckdb:duckdb -7.8% +1.2% -8.9% +12.0% ➖ noise
55 duckdb:vortex-compact -3.6% +1.2% -4.7% +10.0% ➖ noise
55 duckdb:vortex-file-compressed +4.7% +1.2% +3.4% +10.0% ➖ noise
56 datafusion:vortex-compact +3.3% +2.6% +0.6% +14.5% ➖ noise
56 datafusion:vortex-file-compressed +3.8% +2.6% +1.2% +10.0% ➖ noise
56 duckdb:duckdb -2.7% +2.6% -5.2% +10.0% ➖ noise
56 duckdb:vortex-compact +13.7% +2.6% +10.8% +21.7% ➖ noise
56 duckdb:vortex-file-compressed +4.1% +2.6% +1.4% +16.8% ➖ noise
57 datafusion:vortex-compact +3.1% +2.5% +0.6% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +6.7% +2.5% +4.1% +10.0% ➖ noise
57 duckdb:duckdb +0.8% +2.5% -1.7% +10.0% ➖ noise
57 duckdb:vortex-compact +4.4% +2.5% +1.9% +10.0% ➖ noise
57 duckdb:vortex-file-compressed +0.4% +2.5% -2.1% +10.0% ➖ noise
58 datafusion:vortex-compact -1.1% -1.2% +0.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +0.2% -1.2% +1.4% +10.1% ➖ noise
58 duckdb:duckdb -6.9% -1.2% -5.8% +14.6% ➖ noise
58 duckdb:vortex-compact +4.5% -1.2% +5.7% +15.8% ➖ noise
58 duckdb:vortex-file-compressed -1.4% -1.2% -0.3% +13.5% ➖ noise
59 datafusion:vortex-compact +1.2% +0.0% +1.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -0.3% +0.0% -0.3% +10.0% ➖ noise
59 duckdb:duckdb +0.6% +0.0% +0.5% +12.4% ➖ noise
59 duckdb:vortex-compact -26.1% +0.0% -26.1% +10.0% ✅ faster
59 duckdb:vortex-file-compressed -16.8% +0.0% -16.8% +33.9% ➖ noise
60 datafusion:vortex-compact +5.1% +1.1% +3.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +3.4% +1.1% +2.2% +11.2% ➖ noise
60 duckdb:duckdb -3.3% +1.1% -4.4% +10.0% ➖ noise
60 duckdb:vortex-compact -10.5% +1.1% -11.4% +11.7% ✅ faster
60 duckdb:vortex-file-compressed +5.9% +1.1% +4.7% +19.1% ➖ noise
61 datafusion:vortex-compact +0.4% -1.0% +1.4% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +3.0% -1.0% +4.1% +10.0% ➖ noise
61 duckdb:duckdb +2.8% -1.0% +3.9% +10.0% ➖ noise
61 duckdb:vortex-compact -0.1% -1.0% +0.9% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -0.7% -1.0% +0.3% +10.0% ➖ noise
62 datafusion:vortex-compact +30.5% -0.0% +30.5% +35.8% ➖ noise
62 datafusion:vortex-file-compressed +31.0% -0.0% +31.1% +28.8% 🚨 regression
62 duckdb:duckdb +3.1% -0.0% +3.1% +11.7% ➖ noise
62 duckdb:vortex-compact +1.7% -0.0% +1.7% +22.8% ➖ noise
62 duckdb:vortex-file-compressed +5.0% -0.0% +5.1% +14.9% ➖ noise
63 datafusion:vortex-compact +0.3% +1.1% -0.8% +13.8% ➖ noise
63 datafusion:vortex-file-compressed +3.8% +1.1% +2.7% +10.0% ➖ noise
63 duckdb:duckdb +5.4% +1.1% +4.2% +10.0% ➖ noise
63 duckdb:vortex-compact +3.7% +1.1% +2.6% +12.2% ➖ noise
63 duckdb:vortex-file-compressed +1.4% +1.1% +0.3% +10.0% ➖ noise
64 datafusion:vortex-compact +4.6% -0.3% +4.9% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +6.1% -0.3% +6.4% +10.0% ➖ noise
64 duckdb:duckdb -2.3% -0.3% -2.0% +10.0% ➖ noise
64 duckdb:vortex-compact -6.5% -0.3% -6.2% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -0.0% -0.3% +0.3% +11.8% ➖ noise
65 datafusion:vortex-compact +1.2% +0.5% +0.6% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -2.1% +0.5% -2.6% +13.5% ➖ noise
65 duckdb:duckdb +1.0% +0.5% +0.4% +10.0% ➖ noise
65 duckdb:vortex-compact +11.8% +0.5% +11.2% +10.0% 🚨 regression
65 duckdb:vortex-file-compressed -3.2% +0.5% -3.8% +10.0% ➖ noise
66 datafusion:vortex-compact +1.5% +5.3% -3.6% +14.5% ➖ noise
66 datafusion:vortex-file-compressed +1.6% +5.3% -3.5% +10.0% ➖ noise
66 duckdb:duckdb +0.6% +5.3% -4.5% +10.0% ➖ noise
66 duckdb:vortex-compact +4.0% +5.3% -1.2% +13.5% ➖ noise
66 duckdb:vortex-file-compressed +8.7% +5.3% +3.3% +10.0% ➖ noise
67 datafusion:vortex-compact -4.6% -0.3% -4.3% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +3.5% -0.3% +3.8% +10.5% ➖ noise
67 duckdb:duckdb +0.2% -0.3% +0.4% +11.7% ➖ noise
67 duckdb:vortex-compact -0.7% -0.3% -0.5% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +4.5% -0.3% +4.8% +10.8% ➖ noise
68 datafusion:vortex-compact -3.4% -0.5% -2.9% +14.5% ➖ noise
68 datafusion:vortex-file-compressed +2.1% -0.5% +2.6% +10.0% ➖ noise
68 duckdb:duckdb +3.1% -0.5% +3.6% +10.0% ➖ noise
68 duckdb:vortex-compact -5.1% -0.5% -4.6% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -5.2% -0.5% -4.8% +10.0% ➖ noise
69 datafusion:vortex-compact +1.5% +3.8% -2.2% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +3.9% +3.8% +0.1% +10.0% ➖ noise
69 duckdb:duckdb +4.3% +3.8% +0.5% +10.0% ➖ noise
69 duckdb:vortex-compact +2.3% +3.8% -1.5% +10.9% ➖ noise
69 duckdb:vortex-file-compressed +5.3% +3.8% +1.4% +10.0% ➖ noise
70 datafusion:vortex-compact -1.2% +3.3% -4.3% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +2.1% +3.3% -1.2% +11.4% ➖ noise
70 duckdb:duckdb +0.3% +3.3% -2.9% +11.3% ➖ noise
70 duckdb:vortex-compact +2.1% +3.3% -1.1% +10.6% ➖ noise
70 duckdb:vortex-file-compressed +2.4% +3.3% -0.9% +15.2% ➖ noise
71 datafusion:vortex-compact -7.6% +3.5% -10.7% +14.3% ➖ noise
71 datafusion:vortex-file-compressed +2.2% +3.5% -1.3% +16.1% ➖ noise
71 duckdb:duckdb -9.2% +3.5% -12.3% +15.6% ➖ noise
71 duckdb:vortex-compact +3.1% +3.5% -0.5% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +1.1% +3.5% -2.3% +10.0% ➖ noise
72 datafusion:vortex-compact +1.6% +1.5% +0.1% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +3.6% +1.5% +2.1% +10.0% ➖ noise
72 duckdb:duckdb +1.4% +1.5% -0.1% +10.0% ➖ noise
72 duckdb:vortex-compact +2.0% +1.5% +0.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.5% +1.5% -1.0% +10.0% ➖ noise
73 datafusion:vortex-compact +1.3% +10.1% -8.0% +11.4% ➖ noise
73 datafusion:vortex-file-compressed +4.7% +10.1% -4.9% +20.4% ➖ noise
73 duckdb:duckdb +3.3% +10.1% -6.2% +13.1% ➖ noise
73 duckdb:vortex-compact +2.2% +10.1% -7.2% +14.0% ➖ noise
73 duckdb:vortex-file-compressed +1.3% +10.1% -8.0% +12.1% ➖ noise
74 datafusion:vortex-compact +2.2% -1.6% +3.9% +14.5% ➖ noise
74 datafusion:vortex-file-compressed -0.7% -1.6% +0.9% +10.5% ➖ noise
74 duckdb:duckdb +0.3% -1.6% +1.9% +10.0% ➖ noise
74 duckdb:vortex-compact +5.6% -1.6% +7.3% +13.3% ➖ noise
74 duckdb:vortex-file-compressed +4.5% -1.6% +6.2% +15.1% ➖ noise
75 datafusion:vortex-compact +2.0% +3.7% -1.6% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +3.2% +3.7% -0.5% +10.0% ➖ noise
75 duckdb:duckdb -0.1% +3.7% -3.6% +10.0% ➖ noise
75 duckdb:vortex-compact -0.9% +3.7% -4.4% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +0.6% +3.7% -3.0% +10.0% ➖ noise
76 datafusion:vortex-compact +7.9% -1.8% +9.9% +11.8% ➖ noise
76 datafusion:vortex-file-compressed +35.4% -1.8% +37.9% +10.0% 🚨 regression
76 duckdb:duckdb -0.3% -1.8% +1.6% +11.9% ➖ noise
76 duckdb:vortex-compact +0.6% -1.8% +2.5% +15.2% ➖ noise
76 duckdb:vortex-file-compressed +21.9% -1.8% +24.2% +21.4% 🚨 regression
77 datafusion:vortex-compact -2.4% +1.3% -3.6% +13.5% ➖ noise
77 datafusion:vortex-file-compressed +2.8% +1.3% +1.5% +12.3% ➖ noise
77 duckdb:duckdb +3.4% +1.3% +2.1% +10.0% ➖ noise
77 duckdb:vortex-compact +7.7% +1.3% +6.4% +16.3% ➖ noise
77 duckdb:vortex-file-compressed +4.0% +1.3% +2.7% +10.0% ➖ noise
78 datafusion:vortex-compact +2.6% +0.6% +2.0% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +1.2% +0.6% +0.6% +10.0% ➖ noise
78 duckdb:duckdb -0.1% +0.6% -0.7% +10.0% ➖ noise
78 duckdb:vortex-compact +3.0% +0.6% +2.4% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -2.8% +0.6% -3.4% +10.0% ➖ noise
79 datafusion:vortex-compact +8.1% +0.3% +7.8% +12.2% ➖ noise
79 datafusion:vortex-file-compressed +1.3% +0.3% +1.0% +10.0% ➖ noise
79 duckdb:duckdb +0.5% +0.3% +0.3% +14.4% ➖ noise
79 duckdb:vortex-compact +0.1% +0.3% -0.2% +14.6% ➖ noise
79 duckdb:vortex-file-compressed -5.6% +0.3% -5.8% +10.0% ➖ noise
80 datafusion:vortex-compact +4.1% +1.2% +2.9% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.5% +1.2% -0.7% +10.0% ➖ noise
80 duckdb:duckdb +3.5% +1.2% +2.3% +10.0% ➖ noise
80 duckdb:vortex-compact +3.2% +1.2% +2.0% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -0.7% +1.2% -1.9% +12.5% ➖ noise
81 datafusion:vortex-compact +2.9% +1.0% +1.9% +15.3% ➖ noise
81 datafusion:vortex-file-compressed +3.1% +1.0% +2.1% +10.0% ➖ noise
81 duckdb:duckdb -0.2% +1.0% -1.2% +10.0% ➖ noise
81 duckdb:vortex-compact +3.2% +1.0% +2.1% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +7.7% +1.0% +6.7% +13.1% ➖ noise
82 datafusion:vortex-compact +0.6% -2.1% +2.7% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -2.1% -2.1% +0.0% +10.0% ➖ noise
82 duckdb:duckdb -0.1% -2.1% +2.0% +13.2% ➖ noise
82 duckdb:vortex-compact -1.7% -2.1% +0.4% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -0.5% -2.1% +1.6% +11.6% ➖ noise
83 datafusion:vortex-compact +3.7% +1.0% +2.7% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +11.6% +1.0% +10.6% +10.4% 🚨 regression
83 duckdb:duckdb +2.1% +1.0% +1.1% +10.0% ➖ noise
83 duckdb:vortex-compact +8.2% +1.0% +7.1% +20.6% ➖ noise
83 duckdb:vortex-file-compressed +6.1% +1.0% +5.0% +10.0% ➖ noise
84 datafusion:vortex-compact +8.4% +1.9% +6.4% +10.1% ➖ noise
84 datafusion:vortex-file-compressed +4.5% +1.9% +2.5% +10.0% ➖ noise
84 duckdb:duckdb +6.3% +1.9% +4.3% +10.0% ➖ noise
84 duckdb:vortex-compact -23.0% +1.9% -24.4% +10.0% ✅ faster
84 duckdb:vortex-file-compressed -14.1% +1.9% -15.7% +10.0% ✅ faster
85 datafusion:vortex-compact +12.9% +0.3% +12.6% +17.1% ➖ noise
85 datafusion:vortex-file-compressed +2.0% +0.3% +1.8% +10.0% ➖ noise
85 duckdb:duckdb +1.5% +0.3% +1.2% +10.0% ➖ noise
85 duckdb:vortex-compact -6.9% +0.3% -7.2% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -11.4% +0.3% -11.7% +10.0% ✅ faster
86 datafusion:vortex-compact +23.0% +2.5% +19.9% +20.5% ➖ noise
86 datafusion:vortex-file-compressed -1.1% +2.5% -3.5% +13.9% ➖ noise
86 duckdb:duckdb +1.1% +2.5% -1.4% +10.0% ➖ noise
86 duckdb:vortex-compact +5.2% +2.5% +2.6% +15.8% ➖ noise
86 duckdb:vortex-file-compressed -6.7% +2.5% -9.0% +13.0% ➖ noise
87 datafusion:vortex-compact +4.3% -0.6% +4.9% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +7.7% -0.6% +8.3% +10.0% ➖ noise
87 duckdb:duckdb +2.2% -0.6% +2.8% +10.0% ➖ noise
87 duckdb:vortex-compact -0.2% -0.6% +0.4% +12.5% ➖ noise
87 duckdb:vortex-file-compressed +1.7% -0.6% +2.3% +12.9% ➖ noise
88 datafusion:vortex-compact +0.1% +1.8% -1.7% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +2.6% +1.8% +0.7% +10.0% ➖ noise
88 duckdb:duckdb -0.3% +1.8% -2.1% +10.0% ➖ noise
88 duckdb:vortex-compact +3.3% +1.8% +1.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +5.8% +1.8% +3.9% +10.0% ➖ noise
89 datafusion:vortex-compact -1.3% +2.5% -3.7% +15.9% ➖ noise
89 datafusion:vortex-file-compressed -1.3% +2.5% -3.7% +14.4% ➖ noise
89 duckdb:duckdb -3.3% +2.5% -5.6% +12.0% ➖ noise
89 duckdb:vortex-compact +3.0% +2.5% +0.5% +10.7% ➖ noise
89 duckdb:vortex-file-compressed +8.7% +2.5% +6.1% +18.9% ➖ noise
90 datafusion:vortex-compact +4.4% +2.7% +1.7% +11.2% ➖ noise
90 datafusion:vortex-file-compressed +2.5% +2.7% -0.2% +12.7% ➖ noise
90 duckdb:duckdb +7.1% +2.7% +4.3% +10.0% ➖ noise
90 duckdb:vortex-compact +0.2% +2.7% -2.4% +10.8% ➖ noise
90 duckdb:vortex-file-compressed +8.1% +2.7% +5.3% +17.0% ➖ noise
91 datafusion:vortex-compact +1.0% +2.9% -1.8% +11.0% ➖ noise
91 datafusion:vortex-file-compressed +2.5% +2.9% -0.4% +10.0% ➖ noise
91 duckdb:duckdb +11.7% +2.9% +8.6% +10.0% ➖ noise
91 duckdb:vortex-compact -1.6% +2.9% -4.4% +12.1% ➖ noise
91 duckdb:vortex-file-compressed -8.8% +2.9% -11.4% +10.0% ✅ faster
92 datafusion:vortex-compact -2.3% +3.4% -5.4% +11.2% ➖ noise
92 datafusion:vortex-file-compressed +7.7% +3.4% +4.2% +10.0% ➖ noise
92 duckdb:duckdb +3.7% +3.4% +0.3% +10.0% ➖ noise
92 duckdb:vortex-compact -5.8% +3.4% -8.9% +19.8% ➖ noise
92 duckdb:vortex-file-compressed +6.0% +3.4% +2.6% +17.9% ➖ noise
93 datafusion:vortex-compact +4.0% +1.9% +2.0% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +0.9% +1.9% -1.0% +10.0% ➖ noise
93 duckdb:duckdb +2.1% +1.9% +0.1% +10.0% ➖ noise
93 duckdb:vortex-compact -1.4% +1.9% -3.2% +13.3% ➖ noise
93 duckdb:vortex-file-compressed +0.3% +1.9% -1.6% +10.0% ➖ noise
94 datafusion:vortex-compact +5.4% +0.0% +5.4% +10.9% ➖ noise
94 datafusion:vortex-file-compressed +8.8% +0.0% +8.8% +13.0% ➖ noise
94 duckdb:duckdb -0.1% +0.0% -0.1% +10.0% ➖ noise
94 duckdb:vortex-compact +5.9% +0.0% +5.9% +10.0% ➖ noise
94 duckdb:vortex-file-compressed +6.7% +0.0% +6.7% +10.0% ➖ noise
95 datafusion:vortex-compact +3.1% +9.4% -5.7% +11.0% ➖ noise
95 datafusion:vortex-file-compressed +3.7% +9.4% -5.2% +11.0% ➖ noise
95 duckdb:duckdb +12.0% +9.4% +2.3% +21.4% ➖ noise
95 duckdb:vortex-compact +8.2% +9.4% -1.1% +17.0% ➖ noise
95 duckdb:vortex-file-compressed +5.1% +9.4% -4.0% +13.7% ➖ noise
96 datafusion:vortex-compact +0.4% +2.0% -1.5% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +2.3% +2.0% +0.2% +10.0% ➖ noise
96 duckdb:duckdb -2.3% +2.0% -4.2% +10.0% ➖ noise
96 duckdb:vortex-compact +0.4% +2.0% -1.6% +10.0% ➖ noise
96 duckdb:vortex-file-compressed +10.1% +2.0% +8.0% +19.7% ➖ noise
97 datafusion:vortex-compact +1.7% -0.7% +2.3% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +2.1% -0.7% +2.8% +10.0% ➖ noise
97 duckdb:duckdb +1.1% -0.7% +1.7% +10.0% ➖ noise
97 duckdb:vortex-compact -3.9% -0.7% -3.3% +10.0% ➖ noise
97 duckdb:vortex-file-compressed +0.0% -0.7% +0.7% +10.0% ➖ noise
98 datafusion:vortex-compact +3.1% +5.0% -1.8% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +2.5% +5.0% -2.4% +10.0% ➖ noise
98 duckdb:duckdb -0.3% +5.0% -5.1% +10.0% ➖ noise
98 duckdb:vortex-compact +5.8% +5.0% +0.8% +10.7% ➖ noise
98 duckdb:vortex-file-compressed +2.7% +5.0% -2.2% +10.0% ➖ noise
99 datafusion:vortex-compact +3.6% -3.0% +6.8% +20.2% ➖ noise
99 datafusion:vortex-file-compressed +0.0% -3.0% +3.2% +20.7% ➖ noise
99 duckdb:duckdb +0.9% -3.0% +4.1% +28.5% ➖ noise
99 duckdb:vortex-compact +8.3% -3.0% +11.7% +20.3% ➖ noise
99 duckdb:vortex-file-compressed -14.7% -3.0% -12.1% +12.3% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (48 files changed, -0.0% overall, 0↑ 48↓)
File Scale Format Base HEAD Change %
store_sales.vortex 1.0 vortex-file-compressed 97.04 MB 97.04 MB 32 B -0.0%
store_sales.vortex 1.0 vortex-compact 77.87 MB 77.87 MB 32 B -0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.78 MB 70.78 MB 32 B -0.0%
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 59.31 MB 32 B -0.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 36.64 MB 32 B -0.0%
web_sales.vortex 1.0 vortex-file-compressed 34.27 MB 34.27 MB 32 B -0.0%
web_sales.vortex 1.0 vortex-compact 29.35 MB 29.35 MB 32 B -0.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 16.07 MB 32 B -0.0%
store_returns.vortex 1.0 vortex-file-compressed 11.39 MB 11.39 MB 32 B -0.0%
store_returns.vortex 1.0 vortex-compact 9.31 MB 9.31 MB 32 B -0.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.43 MB 7.43 MB 32 B -0.0%
catalog_returns.vortex 1.0 vortex-compact 6.02 MB 6.02 MB 32 B -0.0%
customer.vortex 1.0 vortex-file-compressed 4.52 MB 4.52 MB 32 B -0.0%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 3.55 MB 32 B -0.0%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB 32 B -0.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 2.99 MB 32 B -0.0%
item.vortex 1.0 vortex-file-compressed 1.75 MB 1.75 MB 32 B -0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 1.49 MB 32 B -0.0%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 1.03 MB 32 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 1012.96 KB 1012.93 KB 32 B -0.0%
item.vortex 1.0 vortex-compact 994.21 KB 994.18 KB 32 B -0.0%
time_dim.vortex 1.0 vortex-file-compressed 687.30 KB 687.27 KB 32 B -0.0%
customer_demographics.vortex 1.0 vortex-compact 649.61 KB 649.58 KB 32 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 611.57 KB 611.54 KB 32 B -0.0%
customer_address.vortex 1.0 vortex-compact 558.62 KB 558.59 KB 32 B -0.0%
catalog_page.vortex 1.0 vortex-compact 362.67 KB 362.64 KB 32 B -0.0%
date_dim.vortex 1.0 vortex-compact 154.00 KB 153.96 KB 32 B -0.0%
time_dim.vortex 1.0 vortex-compact 97.35 KB 97.32 KB 32 B -0.0%
promotion.vortex 1.0 vortex-file-compressed 60.19 KB 60.16 KB 32 B -0.1%
call_center.vortex 1.0 vortex-file-compressed 54.94 KB 54.91 KB 32 B -0.1%
web_site.vortex 1.0 vortex-file-compressed 54.08 KB 54.05 KB 32 B -0.1%
promotion.vortex 1.0 vortex-compact 51.51 KB 51.48 KB 32 B -0.1%
call_center.vortex 1.0 vortex-compact 50.14 KB 50.11 KB 32 B -0.1%
store.vortex 1.0 vortex-file-compressed 49.49 KB 49.46 KB 32 B -0.1%
store.vortex 1.0 vortex-compact 45.76 KB 45.73 KB 32 B -0.1%
web_site.vortex 1.0 vortex-compact 45.31 KB 45.28 KB 32 B -0.1%
web_page.vortex 1.0 vortex-file-compressed 31.92 KB 31.89 KB 32 B -0.1%
web_page.vortex 1.0 vortex-compact 27.84 KB 27.80 KB 32 B -0.1%
warehouse.vortex 1.0 vortex-file-compressed 23.83 KB 23.80 KB 32 B -0.1%
warehouse.vortex 1.0 vortex-compact 22.23 KB 22.20 KB 32 B -0.1%
household_demographics.vortex 1.0 vortex-file-compressed 17.05 KB 17.02 KB 32 B -0.2%
ship_mode.vortex 1.0 vortex-file-compressed 13.12 KB 13.09 KB 32 B -0.2%
ship_mode.vortex 1.0 vortex-compact 10.95 KB 10.92 KB 32 B -0.3%
household_demographics.vortex 1.0 vortex-compact 10.79 KB 10.76 KB 32 B -0.3%
reason.vortex 1.0 vortex-file-compressed 7.23 KB 7.20 KB 32 B -0.4%
income_band.vortex 1.0 vortex-file-compressed 6.19 KB 6.16 KB 32 B -0.5%
income_band.vortex 1.0 vortex-compact 5.98 KB 5.95 KB 32 B -0.5%
reason.vortex 1.0 vortex-compact 5.97 KB 5.94 KB 32 B -0.5%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 272.70 MB → 272.70 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.8%
Vortex (geomean): 1.022x ➖
Parquet (geomean): 1.041x ➖
Shifts: Parquet (control) +4.1% · Median polish +4.9%

datafusion / vortex-file-compressed (1.007x ➖, 0↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 52272986 39296095 1.33
fineweb_q01/datafusion:vortex-file-compressed 557361356 522684825 1.07
fineweb_q02/datafusion:vortex-file-compressed 553030835 529805160 1.04
fineweb_q03/datafusion:vortex-file-compressed 1445912822 1583538107 0.91
fineweb_q04/datafusion:vortex-file-compressed 1352475426 1470138063 0.92
fineweb_q05/datafusion:vortex-file-compressed 1357345772 1371343231 0.99
fineweb_q06/datafusion:vortex-file-compressed 1519720716 1536651828 0.99
fineweb_q07/datafusion:vortex-file-compressed 1373553485 1380299089 1.00
fineweb_q08/datafusion:vortex-file-compressed 464061121 527831394 0.88
datafusion / vortex-compact (1.120x ➖, 0↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35723857 33349222 1.07
fineweb_q01/datafusion:vortex-compact 🚨 682517876 521202904 1.31
fineweb_q02/datafusion:vortex-compact 559561978 568123276 0.98
fineweb_q03/datafusion:vortex-compact 1439933887 1348627205 1.07
fineweb_q04/datafusion:vortex-compact 1594824109 1578123926 1.01
fineweb_q05/datafusion:vortex-compact 1620354192 1365143944 1.19
fineweb_q06/datafusion:vortex-compact 1703953245 1341945382 1.27
fineweb_q07/datafusion:vortex-compact 1400142677 1189514816 1.18
fineweb_q08/datafusion:vortex-compact 405298859 386123154 1.05
datafusion / parquet (1.070x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1495848230 1173445655 1.27
fineweb_q01/datafusion:parquet 2058413038 1969027431 1.05
fineweb_q02/datafusion:parquet 1895704484 1879197233 1.01
fineweb_q03/datafusion:parquet 1971195978 2104335714 0.94
fineweb_q04/datafusion:parquet 2039084109 1961964124 1.04
fineweb_q05/datafusion:parquet 2005632650 2001990840 1.00
fineweb_q06/datafusion:parquet 2136724318 1935171272 1.10
fineweb_q07/datafusion:parquet 2179956065 1794976302 1.21
fineweb_q08/datafusion:parquet 1929067359 1839256325 1.05
duckdb / vortex-file-compressed (0.933x ➖, 1↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 100391485 99062788 1.01
fineweb_q01/duckdb:vortex-file-compressed 🚀 608709377 916496520 0.66
fineweb_q02/duckdb:vortex-file-compressed 506547381 593185822 0.85
fineweb_q03/duckdb:vortex-file-compressed 1526129324 1540443574 0.99
fineweb_q04/duckdb:vortex-file-compressed 1493656704 1669298786 0.89
fineweb_q05/duckdb:vortex-file-compressed 1538387943 1535633706 1.00
fineweb_q06/duckdb:vortex-file-compressed 1625517502 1794266856 0.91
fineweb_q07/duckdb:vortex-file-compressed 1526127235 1420748058 1.07
fineweb_q08/duckdb:vortex-file-compressed 655857866 611031437 1.07
duckdb / vortex-compact (1.038x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 101426715 87582895 1.16
fineweb_q01/duckdb:vortex-compact 590167529 605918229 0.97
fineweb_q02/duckdb:vortex-compact 613662901 591438486 1.04
fineweb_q03/duckdb:vortex-compact 1703191135 1748626734 0.97
fineweb_q04/duckdb:vortex-compact 1783219211 1791185634 1.00
fineweb_q05/duckdb:vortex-compact 1657977848 1611146630 1.03
fineweb_q06/duckdb:vortex-compact 1546711378 1515906029 1.02
fineweb_q07/duckdb:vortex-compact 1425927434 1345644378 1.06
fineweb_q08/duckdb:vortex-compact 501944701 453786145 1.11
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1136240294 1314515604 0.86
fineweb_q01/duckdb:parquet 1493276183 1349386569 1.11
fineweb_q02/duckdb:parquet 1358585710 1420255741 0.96
fineweb_q03/duckdb:parquet 3979766588 3824807169 1.04
fineweb_q04/duckdb:parquet 2034433255 1876656051 1.08
fineweb_q05/duckdb:parquet 2273468355 2060690564 1.10
fineweb_q06/duckdb:parquet 4951265991 4491042418 1.10
fineweb_q07/duckdb:parquet 2651983790 2674649220 0.99
fineweb_q08/duckdb:parquet 1105855805 1235316648 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +7.1% +5.0% +2.0% +184.6% ➖ noise
0 datafusion:vortex-file-compressed +33.0% +5.0% +26.7% +121.4% ➖ noise
0 duckdb:vortex-compact +15.8% +5.0% +10.3% +38.1% ➖ noise
0 duckdb:vortex-file-compressed +1.3% +5.0% -3.5% +55.1% ➖ noise
1 datafusion:vortex-compact +31.0% +7.6% +21.7% +64.9% ➖ noise
1 datafusion:vortex-file-compressed +6.6% +7.6% -0.9% +79.5% ➖ noise
1 duckdb:vortex-compact -2.6% +7.6% -9.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -33.6% +7.6% -38.3% +39.4% ✅ faster
2 datafusion:vortex-compact -1.5% -1.8% +0.3% +33.7% ➖ noise
2 datafusion:vortex-file-compressed +4.4% -1.8% +6.3% +52.4% ➖ noise
2 duckdb:vortex-compact +3.8% -1.8% +5.6% +49.8% ➖ noise
2 duckdb:vortex-file-compressed -14.6% -1.8% -13.1% +35.2% ➖ noise
3 datafusion:vortex-compact +6.8% -1.3% +8.1% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -8.7% -1.3% -7.5% +30.0% ➖ noise
3 duckdb:vortex-compact -2.6% -1.3% -1.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -0.9% -1.3% +0.3% +30.0% ➖ noise
4 datafusion:vortex-compact +1.1% +6.1% -4.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -8.0% +6.1% -13.3% +30.0% ➖ noise
4 duckdb:vortex-compact -0.4% +6.1% -6.2% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -10.5% +6.1% -15.7% +30.0% ➖ noise
5 datafusion:vortex-compact +18.7% +5.1% +12.9% +32.4% ➖ noise
5 datafusion:vortex-file-compressed -1.0% +5.1% -5.9% +30.0% ➖ noise
5 duckdb:vortex-compact +2.9% +5.1% -2.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +0.2% +5.1% -4.7% +30.0% ➖ noise
6 datafusion:vortex-compact +27.0% +10.3% +15.1% +30.3% ➖ noise
6 datafusion:vortex-file-compressed -1.1% +10.3% -10.4% +30.0% ➖ noise
6 duckdb:vortex-compact +2.0% +10.3% -7.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -9.4% +10.3% -17.9% +30.0% ➖ noise
7 datafusion:vortex-compact +17.7% +9.7% +7.3% +36.8% ➖ noise
7 datafusion:vortex-file-compressed -0.5% +9.7% -9.3% +30.0% ➖ noise
7 duckdb:vortex-compact +6.0% +9.7% -3.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +7.4% +9.7% -2.1% +30.0% ➖ noise
8 datafusion:vortex-compact +5.0% -3.1% +8.3% +43.4% ➖ noise
8 datafusion:vortex-file-compressed -12.1% -3.1% -9.3% +30.0% ➖ noise
8 duckdb:vortex-compact +10.6% -3.1% +14.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +7.3% -3.1% +10.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +2.1%

duckdb / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12165064 12259392 0.99
statpopgen_q01/duckdb:vortex-file-compressed 26501064 27842549 0.95
statpopgen_q02/duckdb:vortex-file-compressed 550537768 525742720 1.05
statpopgen_q03/duckdb:vortex-file-compressed 1087280882 1052500509 1.03
statpopgen_q04/duckdb:vortex-file-compressed 1056697095 1060133510 1.00
statpopgen_q05/duckdb:vortex-file-compressed 503823897 480726365 1.05
statpopgen_q06/duckdb:vortex-file-compressed 1561603048 1544825418 1.01
statpopgen_q07/duckdb:vortex-file-compressed 218163967 208051323 1.05
statpopgen_q08/duckdb:vortex-file-compressed 243689231 237853247 1.02
statpopgen_q09/duckdb:vortex-file-compressed 856064118 859870552 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2624548071 2581225459 1.02
duckdb / vortex-compact (1.024x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12528654 12255795 1.02
statpopgen_q01/duckdb:vortex-compact 216942370 216429644 1.00
statpopgen_q02/duckdb:vortex-compact 572619681 558820974 1.02
statpopgen_q03/duckdb:vortex-compact 1163997483 1137246823 1.02
statpopgen_q04/duckdb:vortex-compact 1219073450 1160927583 1.05
statpopgen_q05/duckdb:vortex-compact 570845168 565074513 1.01
statpopgen_q06/duckdb:vortex-compact 1522651704 1478451718 1.03
statpopgen_q07/duckdb:vortex-compact 900435674 879116738 1.02
statpopgen_q08/duckdb:vortex-compact 930315450 909803117 1.02
statpopgen_q09/duckdb:vortex-compact 949455063 926662778 1.02
statpopgen_q10/duckdb:vortex-compact 2663504231 2582507956 1.03
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 296730084 303511752 0.98
statpopgen_q01/duckdb:parquet 384660855 379902131 1.01
statpopgen_q02/duckdb:parquet 760838554 767359716 0.99
statpopgen_q03/duckdb:parquet 1173433024 1193837666 0.98
statpopgen_q04/duckdb:parquet 1196343603 1188751421 1.01
statpopgen_q05/duckdb:parquet 806034394 811523257 0.99
statpopgen_q06/duckdb:parquet 1414098391 1421995008 0.99
statpopgen_q07/duckdb:parquet 849449015 849610367 1.00
statpopgen_q08/duckdb:parquet 866105696 850978944 1.02
statpopgen_q09/duckdb:parquet 999866626 1011891106 0.99
statpopgen_q10/duckdb:parquet 2235378827 2188015849 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +2.2% -2.2% +4.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.8% -2.2% +1.5% +14.4% ➖ noise
1 duckdb:vortex-compact +0.2% +1.3% -1.0% +42.0% ➖ noise
1 duckdb:vortex-file-compressed -4.8% +1.3% -6.0% +213.9% ➖ noise
2 duckdb:vortex-compact +2.5% -0.8% +3.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.7% -0.8% +5.6% +10.0% ➖ noise
3 duckdb:vortex-compact +2.4% -1.7% +4.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.3% -1.7% +5.1% +10.0% ➖ noise
4 duckdb:vortex-compact +5.0% +0.6% +4.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.3% +0.6% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +1.0% -0.7% +1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.8% -0.7% +5.5% +10.0% ➖ noise
6 duckdb:vortex-compact +3.0% -0.6% +3.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.1% -0.6% +1.7% +10.0% ➖ noise
7 duckdb:vortex-compact +2.4% -0.0% +2.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.9% -0.0% +4.9% +10.0% ➖ noise
8 duckdb:vortex-compact +2.3% +1.8% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.5% +1.8% +0.7% +10.0% ➖ noise
9 duckdb:vortex-compact +2.5% -1.2% +3.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.4% -1.2% +0.8% +10.2% ➖ noise
10 duckdb:vortex-compact +3.1% +2.2% +1.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.7% +2.2% -0.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.97 GB 1.97 GB 32 B -0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.35 MB 959.35 MB 32 B -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (-0.0%)
  • vortex-file-compressed: 1.97 GB → 1.97 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: Random Access

Vortex (geomean): 0.912x ➖
Parquet (geomean): 0.935x ➖

unknown / unknown (0.949x ➖, 11↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 382019 363961 1.05
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1017017 1015237 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8060093895 8223518073 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8097064081 8204570546 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 7564750 8681736 0.87
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 6725643 7660045 0.88
random-access/feature-vectors/uniform/lance-tokio-local-disk 1201187 1214639 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1856819 1871872 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8101828935 8236020056 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 🚀 8096484030 9203926849 0.88
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 13208689 15273442 0.86
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12904516 13194414 0.98
random-access/lance-tokio-local-disk 678574 647506 1.05
random-access/lance-tokio-local-disk-footer 1396949 1417390 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk 236162 239732 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 577132 583788 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 128082115 130729722 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128343278 129923445 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 529377 616616 0.86
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 554253 631551 0.88
random-access/nested-lists/uniform/lance-tokio-local-disk 1022632 1036363 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1379427 1393038 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk 128909505 141273358 0.91
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 128663165 130648657 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk 2095132 2154264 0.97
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2098512 2165857 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk 367107 371072 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 546395 549213 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 20547248 22986504 0.89
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 20623185 22255260 0.93
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 637627 894705 0.71
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 703374 727223 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk 2562213 2596746 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2760575 2826551 0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 20445985 26971800 0.76
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 20603832 27017751 0.76
random-access/nested-structs/uniform/vortex-tokio-local-disk 1528975 1596217 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1618830 1567036 1.03
random-access/parquet-tokio-local-disk 166402773 167812486 0.99
random-access/parquet-tokio-local-disk-footer 166704353 174200957 0.96
random-access/taxi/correlated/lance-tokio-local-disk 990576 993566 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚨 2076336 1835673 1.13
random-access/taxi/correlated/parquet-tokio-local-disk 246796614 267647677 0.92
random-access/taxi/correlated/parquet-tokio-local-disk-footer 246606675 249684493 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1481180 1775650 0.83
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1945046 1945345 1.00
random-access/taxi/uniform/lance-tokio-local-disk 9536542 9741961 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 10032957 10228384 0.98
random-access/taxi/uniform/parquet-tokio-local-disk 264017555 264792518 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 263834304 264109533 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 5098489 5596696 0.91
random-access/taxi/uniform/vortex-tokio-local-disk-footer 5088249 5403106 0.94
random-access/vortex-tokio-local-disk 1139047 1231774 0.92
random-access/vortex-tokio-local-disk-footer 1153472 1254708 0.92

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Vortex (geomean): 1.036x ➖
Parquet (geomean): 1.024x ➖
Shifts: Parquet (control) +2.4% · Median polish +3.1%

datafusion / vortex-file-compressed (1.035x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 396071465 399217453 0.99
tpch_q02/datafusion:vortex-file-compressed 109346030 104161576 1.05
tpch_q03/datafusion:vortex-file-compressed 222012841 210061688 1.06
tpch_q04/datafusion:vortex-file-compressed 116206418 110853496 1.05
tpch_q05/datafusion:vortex-file-compressed 381900590 363553609 1.05
tpch_q06/datafusion:vortex-file-compressed 36912065 35941029 1.03
tpch_q07/datafusion:vortex-file-compressed 518934479 497533422 1.04
tpch_q08/datafusion:vortex-file-compressed 362719414 346686224 1.05
tpch_q09/datafusion:vortex-file-compressed 638999554 619738459 1.03
tpch_q10/datafusion:vortex-file-compressed 229112347 225746821 1.01
tpch_q11/datafusion:vortex-file-compressed 82424502 79184946 1.04
tpch_q12/datafusion:vortex-file-compressed 116763149 114246052 1.02
tpch_q13/datafusion:vortex-file-compressed 218489978 212767323 1.03
tpch_q14/datafusion:vortex-file-compressed 53217715 52575801 1.01
tpch_q15/datafusion:vortex-file-compressed 99250719 95922507 1.03
tpch_q16/datafusion:vortex-file-compressed 77925949 73688887 1.06
tpch_q17/datafusion:vortex-file-compressed 648746342 623122006 1.04
tpch_q18/datafusion:vortex-file-compressed 871891158 820957841 1.06
tpch_q19/datafusion:vortex-file-compressed 70750250 66855537 1.06
tpch_q20/datafusion:vortex-file-compressed 165166891 160639287 1.03
tpch_q21/datafusion:vortex-file-compressed 678785125 646344193 1.05
tpch_q22/datafusion:vortex-file-compressed 64848143 65493723 0.99
datafusion / vortex-compact (1.046x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 457191633 429066569 1.07
tpch_q02/datafusion:vortex-compact 114918056 106702291 1.08
tpch_q03/datafusion:vortex-compact 220017363 212607316 1.03
tpch_q04/datafusion:vortex-compact 121544177 118971283 1.02
tpch_q05/datafusion:vortex-compact 386119874 369411382 1.05
tpch_q06/datafusion:vortex-compact 59045323 57661482 1.02
tpch_q07/datafusion:vortex-compact 536179916 514190150 1.04
tpch_q08/datafusion:vortex-compact 371813855 352862357 1.05
tpch_q09/datafusion:vortex-compact 658802174 626638193 1.05
tpch_q10/datafusion:vortex-compact 249174450 237482560 1.05
tpch_q11/datafusion:vortex-compact 87956751 80675433 1.09
tpch_q12/datafusion:vortex-compact 164016895 157811766 1.04
tpch_q13/datafusion:vortex-compact 271445222 258577136 1.05
tpch_q14/datafusion:vortex-compact 72238695 69446716 1.04
tpch_q15/datafusion:vortex-compact 159658146 150490218 1.06
tpch_q16/datafusion:vortex-compact 81383186 77542764 1.05
tpch_q17/datafusion:vortex-compact 658603351 625014953 1.05
tpch_q18/datafusion:vortex-compact 881930371 827107842 1.07
tpch_q19/datafusion:vortex-compact 125025955 127077711 0.98
tpch_q20/datafusion:vortex-compact 189042059 181650646 1.04
tpch_q21/datafusion:vortex-compact 685818623 654102689 1.05
tpch_q22/datafusion:vortex-compact 74262694 71491072 1.04
datafusion / parquet (1.030x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 455333218 464868950 0.98
tpch_q02/datafusion:parquet 179097559 166892338 1.07
tpch_q03/datafusion:parquet 290715458 280585511 1.04
tpch_q04/datafusion:parquet 132141115 125172772 1.06
tpch_q05/datafusion:parquet 446843550 427423437 1.05
tpch_q06/datafusion:parquet 122995135 121575072 1.01
tpch_q07/datafusion:parquet 613689709 597158578 1.03
tpch_q08/datafusion:parquet 473965616 453269095 1.05
tpch_q09/datafusion:parquet 759544343 725273097 1.05
tpch_q10/datafusion:parquet 496191959 485309639 1.02
tpch_q11/datafusion:parquet 116765428 114992588 1.02
tpch_q12/datafusion:parquet 197776033 203396713 0.97
tpch_q13/datafusion:parquet 334771532 327654592 1.02
tpch_q14/datafusion:parquet 162598267 154105984 1.06
tpch_q15/datafusion:parquet 250685856 242729650 1.03
tpch_q16/datafusion:parquet 124139458 120951537 1.03
tpch_q17/datafusion:parquet 694719905 671671472 1.03
tpch_q18/datafusion:parquet 921733760 855271972 1.08
tpch_q19/datafusion:parquet 264669892 260836787 1.01
tpch_q20/datafusion:parquet 292303888 283186898 1.03
tpch_q21/datafusion:parquet 710842635 679952649 1.05
tpch_q22/datafusion:parquet 209494883 211630287 0.99
datafusion / arrow (1.046x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 612371216 586816663 1.04
tpch_q02/datafusion:arrow 172136406 161236933 1.07
tpch_q03/datafusion:arrow 476462581 459554781 1.04
tpch_q04/datafusion:arrow 351579607 338889391 1.04
tpch_q05/datafusion:arrow 955034964 915170451 1.04
tpch_q06/datafusion:arrow 295597367 279622606 1.06
tpch_q07/datafusion:arrow 1199418142 1135097090 1.06
tpch_q08/datafusion:arrow 1183205064 1110853696 1.07
tpch_q09/datafusion:arrow 1397421687 1320035869 1.06
tpch_q10/datafusion:arrow 608042206 578993240 1.05
tpch_q11/datafusion:arrow 141023066 137002770 1.03
tpch_q12/datafusion:arrow 669554496 656656309 1.02
tpch_q13/datafusion:arrow 512933297 496977346 1.03
tpch_q14/datafusion:arrow 335258312 313143915 1.07
tpch_q15/datafusion:arrow 721023145 677479607 1.06
tpch_q16/datafusion:arrow 107704854 103584528 1.04
tpch_q17/datafusion:arrow 1371471761 1310010684 1.05
tpch_q18/datafusion:arrow 1944314763 1857791823 1.05
tpch_q19/datafusion:arrow 497252918 488244373 1.02
tpch_q20/datafusion:arrow 506132314 477927474 1.06
tpch_q21/datafusion:arrow 3037618084 2960180098 1.03
tpch_q22/datafusion:arrow 133464451 126951770 1.05
duckdb / vortex-file-compressed (1.031x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 173123415 172230310 1.01
tpch_q02/duckdb:vortex-file-compressed 53663525 53268592 1.01
tpch_q03/duckdb:vortex-file-compressed 129567416 125740237 1.03
tpch_q04/duckdb:vortex-file-compressed 167349441 160169095 1.04
tpch_q05/duckdb:vortex-file-compressed 141606953 138035116 1.03
tpch_q06/duckdb:vortex-file-compressed 34262170 32089003 1.07
tpch_q07/duckdb:vortex-file-compressed 139155640 134770168 1.03
tpch_q08/duckdb:vortex-file-compressed 177514002 168501959 1.05
tpch_q09/duckdb:vortex-file-compressed 403981563 394855180 1.02
tpch_q10/duckdb:vortex-file-compressed 193204177 192010422 1.01
tpch_q11/duckdb:vortex-file-compressed 33261836 32817220 1.01
tpch_q12/duckdb:vortex-file-compressed 101641709 99564250 1.02
tpch_q13/duckdb:vortex-file-compressed 238385048 228259610 1.04
tpch_q14/duckdb:vortex-file-compressed 56018375 54304907 1.03
tpch_q15/duckdb:vortex-file-compressed 94558788 89009139 1.06
tpch_q16/duckdb:vortex-file-compressed 79640339 78057124 1.02
tpch_q17/duckdb:vortex-file-compressed 99236209 94354642 1.05
tpch_q18/duckdb:vortex-file-compressed 291257735 282838005 1.03
tpch_q19/duckdb:vortex-file-compressed 80191034 77935858 1.03
tpch_q20/duckdb:vortex-file-compressed 155539434 152586418 1.02
tpch_q21/duckdb:vortex-file-compressed 506924225 487809528 1.04
tpch_q22/duckdb:vortex-file-compressed 66578143 64959598 1.02
duckdb / vortex-compact (1.032x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 233230457 227404777 1.03
tpch_q02/duckdb:vortex-compact 59301567 58124614 1.02
tpch_q03/duckdb:vortex-compact 142731688 136990028 1.04
tpch_q04/duckdb:vortex-compact 179134468 172542740 1.04
tpch_q05/duckdb:vortex-compact 169235058 164627630 1.03
tpch_q06/duckdb:vortex-compact 56196185 55306607 1.02
tpch_q07/duckdb:vortex-compact 177504982 172131014 1.03
tpch_q08/duckdb:vortex-compact 195539483 187093001 1.05
tpch_q09/duckdb:vortex-compact 431249949 426608174 1.01
tpch_q10/duckdb:vortex-compact 221280054 217925607 1.02
tpch_q11/duckdb:vortex-compact 39762562 38054960 1.04
tpch_q12/duckdb:vortex-compact 165523685 161648904 1.02
tpch_q13/duckdb:vortex-compact 285420574 274280999 1.04
tpch_q14/duckdb:vortex-compact 74762905 73722052 1.01
tpch_q15/duckdb:vortex-compact 120104418 113350999 1.06
tpch_q16/duckdb:vortex-compact 81634538 79670621 1.02
tpch_q17/duckdb:vortex-compact 111177983 107167252 1.04
tpch_q18/duckdb:vortex-compact 297201005 285754447 1.04
tpch_q19/duckdb:vortex-compact 98871109 94645406 1.04
tpch_q20/duckdb:vortex-compact 188532135 181977537 1.04
tpch_q21/duckdb:vortex-compact 530194836 514278982 1.03
tpch_q22/duckdb:vortex-compact 73697931 70817759 1.04
duckdb / parquet (1.018x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265962917 263345503 1.01
tpch_q02/duckdb:parquet 99741502 103428124 0.96
tpch_q03/duckdb:parquet 214493662 206345078 1.04
tpch_q04/duckdb:parquet 139929240 129930729 1.08
tpch_q05/duckdb:parquet 228656939 228354381 1.00
tpch_q06/duckdb:parquet 74160485 74955943 0.99
tpch_q07/duckdb:parquet 186250261 185355269 1.00
tpch_q08/duckdb:parquet 273579375 263636128 1.04
tpch_q09/duckdb:parquet 495049870 465383304 1.06
tpch_q10/duckdb:parquet 629983364 621849455 1.01
tpch_q11/duckdb:parquet 66656907 63231869 1.05
tpch_q12/duckdb:parquet 132213614 129576980 1.02
tpch_q13/duckdb:parquet 452088108 442788302 1.02
tpch_q14/duckdb:parquet 179398916 177628948 1.01
tpch_q15/duckdb:parquet 105648382 105605566 1.00
tpch_q16/duckdb:parquet 163383639 164643379 0.99
tpch_q17/duckdb:parquet 183221247 182908534 1.00
tpch_q18/duckdb:parquet 365531613 361754947 1.01
tpch_q19/duckdb:parquet 291027768 285075679 1.02
tpch_q20/duckdb:parquet 232421828 219799796 1.06
tpch_q21/duckdb:parquet 565599754 559717542 1.01
tpch_q22/duckdb:parquet 296649485 292697763 1.01
duckdb / duckdb (1.023x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 121038881 120139444 1.01
tpch_q02/duckdb:duckdb 52593771 51701829 1.02
tpch_q03/duckdb:duckdb 104391660 103356506 1.01
tpch_q04/duckdb:duckdb 143938513 137902960 1.04
tpch_q05/duckdb:duckdb 121400959 118849686 1.02
tpch_q06/duckdb:duckdb 45364162 44658774 1.02
tpch_q07/duckdb:duckdb 93007264 91298947 1.02
tpch_q08/duckdb:duckdb 119820933 118491893 1.01
tpch_q09/duckdb:duckdb 285169628 279726361 1.02
tpch_q10/duckdb:duckdb 217768039 213537362 1.02
tpch_q11/duckdb:duckdb 19860644 19044181 1.04
tpch_q12/duckdb:duckdb 92484925 89458147 1.03
tpch_q13/duckdb:duckdb 233799053 231411875 1.01
tpch_q14/duckdb:duckdb 79503416 77644597 1.02
tpch_q15/duckdb:duckdb 82689597 81483449 1.01
tpch_q16/duckdb:duckdb 78020902 75595094 1.03
tpch_q17/duckdb:duckdb 88491469 87809796 1.01
tpch_q18/duckdb:duckdb 237097572 234827696 1.01
tpch_q19/duckdb:duckdb 124141999 123792415 1.00
tpch_q20/duckdb:duckdb 118791438 116873267 1.02
tpch_q21/duckdb:duckdb 308978841 297815784 1.04
tpch_q22/duckdb:duckdb 71999681 65822098 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.4% -0.5% +4.9% +10.0% ➖ noise
1 datafusion:vortex-compact +6.6% -0.5% +7.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -0.8% -0.5% -0.2% +10.0% ➖ noise
1 duckdb:duckdb +0.7% -0.5% +1.3% +10.0% ➖ noise
1 duckdb:vortex-compact +2.6% -0.5% +3.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +0.5% -0.5% +1.1% +10.0% ➖ noise
2 datafusion:arrow +6.8% +1.7% +4.9% +10.0% ➖ noise
2 datafusion:vortex-compact +7.7% +1.7% +5.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.0% +1.7% +3.2% +10.0% ➖ noise
2 duckdb:duckdb +1.7% +1.7% -0.0% +10.0% ➖ noise
2 duckdb:vortex-compact +2.0% +1.7% +0.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.7% +1.7% -1.0% +10.0% ➖ noise
3 datafusion:arrow +3.7% +3.8% -0.1% +10.0% ➖ noise
3 datafusion:vortex-compact +3.5% +3.8% -0.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.7% +3.8% +1.8% +10.0% ➖ noise
3 duckdb:duckdb +1.0% +3.8% -2.7% +10.0% ➖ noise
3 duckdb:vortex-compact +4.2% +3.8% +0.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.0% +3.8% -0.7% +10.0% ➖ noise
4 datafusion:arrow +3.7% +6.6% -2.7% +10.0% ➖ noise
4 datafusion:vortex-compact +2.2% +6.6% -4.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +4.8% +6.6% -1.7% +10.0% ➖ noise
4 duckdb:duckdb +4.4% +6.6% -2.1% +10.0% ➖ noise
4 duckdb:vortex-compact +3.8% +6.6% -2.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.5% +6.6% -2.0% +10.0% ➖ noise
5 datafusion:arrow +4.4% +2.3% +2.0% +10.0% ➖ noise
5 datafusion:vortex-compact +4.5% +2.3% +2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.0% +2.3% +2.7% +10.0% ➖ noise
5 duckdb:duckdb +2.1% +2.3% -0.2% +10.0% ➖ noise
5 duckdb:vortex-compact +2.8% +2.3% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.6% +2.3% +0.3% +10.0% ➖ noise
6 datafusion:arrow +5.7% +0.0% +5.7% +10.0% ➖ noise
6 datafusion:vortex-compact +2.4% +0.0% +2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.7% +0.0% +2.7% +10.0% ➖ noise
6 duckdb:duckdb +1.6% +0.0% +1.5% +10.0% ➖ noise
6 duckdb:vortex-compact +1.6% +0.0% +1.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.8% +0.0% +6.7% +14.3% ➖ noise
7 datafusion:arrow +5.7% +1.6% +4.0% +10.0% ➖ noise
7 datafusion:vortex-compact +4.3% +1.6% +2.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.3% +1.6% +2.6% +10.0% ➖ noise
7 duckdb:duckdb +1.9% +1.6% +0.2% +10.0% ➖ noise
7 duckdb:vortex-compact +3.1% +1.6% +1.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.3% +1.6% +1.6% +10.0% ➖ noise
8 datafusion:arrow +6.5% +4.2% +2.3% +10.0% ➖ noise
8 datafusion:vortex-compact +5.4% +4.2% +1.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +4.6% +4.2% +0.4% +10.0% ➖ noise
8 duckdb:duckdb +1.1% +4.2% -2.9% +10.0% ➖ noise
8 duckdb:vortex-compact +4.5% +4.2% +0.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.3% +4.2% +1.1% +10.0% ➖ noise
9 datafusion:arrow +5.9% +5.5% +0.3% +10.0% ➖ noise
9 datafusion:vortex-compact +5.1% +5.5% -0.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.1% +5.5% -2.3% +10.0% ➖ noise
9 duckdb:duckdb +1.9% +5.5% -3.4% +10.0% ➖ noise
9 duckdb:vortex-compact +1.1% +5.5% -4.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.3% +5.5% -3.1% +10.0% ➖ noise
10 datafusion:arrow +5.0% +1.8% +3.2% +10.0% ➖ noise
10 datafusion:vortex-compact +4.9% +1.8% +3.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.5% +1.8% -0.3% +10.0% ➖ noise
10 duckdb:duckdb +2.0% +1.8% +0.2% +10.0% ➖ noise
10 duckdb:vortex-compact +1.5% +1.8% -0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.6% +1.8% -1.1% +10.0% ➖ noise
11 datafusion:arrow +2.9% +3.5% -0.5% +10.0% ➖ noise
11 datafusion:vortex-compact +9.0% +3.5% +5.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.1% +3.5% +0.6% +10.0% ➖ noise
11 duckdb:duckdb +4.3% +3.5% +0.8% +10.0% ➖ noise
11 duckdb:vortex-compact +4.5% +3.5% +1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.4% +3.5% -2.0% +10.0% ➖ noise
12 datafusion:arrow +2.0% -0.4% +2.4% +41.9% ➖ noise
12 datafusion:vortex-compact +3.9% -0.4% +4.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.2% -0.4% +2.6% +10.0% ➖ noise
12 duckdb:duckdb +3.4% -0.4% +3.8% +10.0% ➖ noise
12 duckdb:vortex-compact +2.4% -0.4% +2.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.1% -0.4% +2.5% +10.0% ➖ noise
13 datafusion:arrow +3.2% +2.1% +1.1% +10.0% ➖ noise
13 datafusion:vortex-compact +5.0% +2.1% +2.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.7% +2.1% +0.5% +10.0% ➖ noise
13 duckdb:duckdb +1.0% +2.1% -1.1% +10.0% ➖ noise
13 duckdb:vortex-compact +4.1% +2.1% +1.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +4.4% +2.1% +2.3% +10.0% ➖ noise
14 datafusion:arrow +7.1% +3.2% +3.7% +10.0% ➖ noise
14 datafusion:vortex-compact +4.0% +3.2% +0.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.2% +3.2% -1.9% +10.0% ➖ noise
14 duckdb:duckdb +2.4% +3.2% -0.8% +10.0% ➖ noise
14 duckdb:vortex-compact +1.4% +3.2% -1.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +3.2% +3.2% -0.1% +10.0% ➖ noise
15 datafusion:arrow +6.4% +1.6% +4.7% +10.0% ➖ noise
15 datafusion:vortex-compact +6.1% +1.6% +4.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +3.5% +1.6% +1.8% +10.0% ➖ noise
15 duckdb:duckdb +1.5% +1.6% -0.2% +10.0% ➖ noise
15 duckdb:vortex-compact +6.0% +1.6% +4.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +6.2% +1.6% +4.5% +10.0% ➖ noise
16 datafusion:arrow +4.0% +0.9% +3.0% +10.0% ➖ noise
16 datafusion:vortex-compact +5.0% +0.9% +4.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.7% +0.9% +4.8% +10.0% ➖ noise
16 duckdb:duckdb +3.2% +0.9% +2.3% +10.0% ➖ noise
16 duckdb:vortex-compact +2.5% +0.9% +1.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.0% +0.9% +1.1% +10.0% ➖ noise
17 datafusion:arrow +4.7% +1.8% +2.9% +10.0% ➖ noise
17 datafusion:vortex-compact +5.4% +1.8% +3.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +4.1% +1.8% +2.3% +10.0% ➖ noise
17 duckdb:duckdb +0.8% +1.8% -1.0% +10.0% ➖ noise
17 duckdb:vortex-compact +3.7% +1.8% +1.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +5.2% +1.8% +3.3% +10.0% ➖ noise
18 datafusion:arrow +4.7% +4.4% +0.3% +10.0% ➖ noise
18 datafusion:vortex-compact +6.6% +4.4% +2.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +6.2% +4.4% +1.8% +10.0% ➖ noise
18 duckdb:duckdb +1.0% +4.4% -3.2% +10.0% ➖ noise
18 duckdb:vortex-compact +4.0% +4.4% -0.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.0% +4.4% -1.3% +10.0% ➖ noise
19 datafusion:arrow +1.8% +1.8% +0.1% +10.0% ➖ noise
19 datafusion:vortex-compact -1.6% +1.8% -3.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +5.8% +1.8% +4.0% +10.0% ➖ noise
19 duckdb:duckdb +0.3% +1.8% -1.5% +10.0% ➖ noise
19 duckdb:vortex-compact +4.5% +1.8% +2.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.9% +1.8% +1.1% +10.0% ➖ noise
20 datafusion:arrow +5.9% +4.5% +1.4% +10.0% ➖ noise
20 datafusion:vortex-compact +4.1% +4.5% -0.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +2.8% +4.5% -1.6% +10.0% ➖ noise
20 duckdb:duckdb +1.6% +4.5% -2.7% +10.0% ➖ noise
20 duckdb:vortex-compact +3.6% +4.5% -0.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.9% +4.5% -2.4% +10.0% ➖ noise
21 datafusion:arrow +2.6% +2.8% -0.2% +10.0% ➖ noise
21 datafusion:vortex-compact +4.8% +2.8% +2.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +5.0% +2.8% +2.2% +10.0% ➖ noise
21 duckdb:duckdb +3.7% +2.8% +0.9% +10.0% ➖ noise
21 duckdb:vortex-compact +3.1% +2.8% +0.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +3.9% +2.8% +1.1% +10.0% ➖ noise
22 datafusion:arrow +5.1% +0.2% +5.0% +10.0% ➖ noise
22 datafusion:vortex-compact +3.9% +0.2% +3.7% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.0% +0.2% -1.1% +10.0% ➖ noise
22 duckdb:duckdb +9.4% +0.2% +9.2% +10.0% ➖ noise
22 duckdb:vortex-compact +4.1% +0.2% +3.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +2.5% +0.2% +2.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: TPC-H SF=10 on NVME

File Size Changes (48 files changed, -0.0% overall, 0↑ 48↓)
File Scale Format Base HEAD Change %
partsupp_1.vortex 10.0 vortex-file-compressed 180.65 MB 180.65 MB 32 B -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 180.47 MB 180.47 MB 32 B -0.0%
orders_1.vortex 10.0 vortex-file-compressed 164.15 MB 164.15 MB 32 B -0.0%
orders_2.vortex 10.0 vortex-file-compressed 164.00 MB 164.00 MB 32 B -0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.92 MB 163.92 MB 32 B -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.87 MB 134.87 MB 32 B -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 32 B -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 32 B -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.52 MB 134.52 MB 32 B -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.51 MB 134.51 MB 32 B -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.43 MB 134.43 MB 32 B -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.38 MB 32 B -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 134.27 MB 134.27 MB 32 B -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 134.06 MB 134.06 MB 32 B -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 134.01 MB 134.01 MB 32 B -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.86 MB 133.86 MB 32 B -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.74 MB 133.74 MB 32 B -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 133.23 MB 133.23 MB 32 B -0.0%
partsupp_0.vortex 10.0 vortex-compact 126.76 MB 126.76 MB 32 B -0.0%
partsupp_1.vortex 10.0 vortex-compact 126.74 MB 126.74 MB 32 B -0.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 114.79 MB 32 B -0.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 114.78 MB 32 B -0.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 114.76 MB 32 B -0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.73 MB 104.73 MB 32 B -0.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 100.70 MB 32 B -0.0%
lineitem_6.vortex 10.0 vortex-compact 100.68 MB 100.68 MB 32 B -0.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 100.64 MB 32 B -0.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_3.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_2.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_7.vortex 10.0 vortex-compact 100.58 MB 100.58 MB 32 B -0.0%
lineitem_4.vortex 10.0 vortex-compact 100.56 MB 100.56 MB 32 B -0.0%
lineitem_11.vortex 10.0 vortex-compact 100.53 MB 100.53 MB 32 B -0.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 100.46 MB 32 B -0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.12 MB 32 B -0.0%
part_0.vortex 10.0 vortex-file-compressed 27.02 MB 27.02 MB 32 B -0.0%
part_1.vortex 10.0 vortex-file-compressed 26.99 MB 26.99 MB 32 B -0.0%
part_1.vortex 10.0 vortex-compact 18.11 MB 18.11 MB 32 B -0.0%
part_0.vortex 10.0 vortex-compact 18.11 MB 18.11 MB 32 B -0.0%
supplier_0.vortex 10.0 vortex-file-compressed 6.69 MB 6.69 MB 32 B -0.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 4.73 MB 32 B -0.0%
nation_0.vortex 10.0 vortex-file-compressed 11.00 KB 10.97 KB 32 B -0.3%
nation_0.vortex 10.0 vortex-compact 8.34 KB 8.31 KB 32 B -0.4%
region_0.vortex 10.0 vortex-file-compressed 6.16 KB 6.13 KB 32 B -0.5%
region_0.vortex 10.0 vortex-compact 5.86 KB 5.82 KB 32 B -0.5%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (-0.0%)
  • vortex-file-compressed: 2.70 GB → 2.70 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +1.4%

datafusion / vortex-file-compressed (1.022x ➖, 0↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1677168 1617609 1.04
clickbench_q01/datafusion:vortex-file-compressed 19691672 18861292 1.04
clickbench_q02/datafusion:vortex-file-compressed 38738449 38625118 1.00
clickbench_q03/datafusion:vortex-file-compressed 45216276 41876811 1.08
clickbench_q04/datafusion:vortex-file-compressed 286041689 276970196 1.03
clickbench_q05/datafusion:vortex-file-compressed 317908100 302201897 1.05
clickbench_q06/datafusion:vortex-file-compressed 1623382 1686146 0.96
clickbench_q07/datafusion:vortex-file-compressed 23297720 22915951 1.02
clickbench_q08/datafusion:vortex-file-compressed 353626521 346891464 1.02
clickbench_q09/datafusion:vortex-file-compressed 550492172 546487541 1.01
clickbench_q10/datafusion:vortex-file-compressed 75799909 73745331 1.03
clickbench_q11/datafusion:vortex-file-compressed 88938239 84828519 1.05
clickbench_q12/datafusion:vortex-file-compressed 268412729 262042665 1.02
clickbench_q13/datafusion:vortex-file-compressed 413822280 406872160 1.02
clickbench_q14/datafusion:vortex-file-compressed 257813384 247010876 1.04
clickbench_q15/datafusion:vortex-file-compressed 332895613 324175977 1.03
clickbench_q16/datafusion:vortex-file-compressed 653462851 630722026 1.04
clickbench_q17/datafusion:vortex-file-compressed 644222359 627301647 1.03
clickbench_q18/datafusion:vortex-file-compressed 1284239208 1266716959 1.01
clickbench_q19/datafusion:vortex-file-compressed 35907871 37249536 0.96
clickbench_q20/datafusion:vortex-file-compressed 345827215 343995768 1.01
clickbench_q21/datafusion:vortex-file-compressed 379034676 367013150 1.03
clickbench_q22/datafusion:vortex-file-compressed 454786986 447219237 1.02
clickbench_q23/datafusion:vortex-file-compressed 🚨 673945089 609560986 1.11
clickbench_q24/datafusion:vortex-file-compressed 45540328 48616275 0.94
clickbench_q25/datafusion:vortex-file-compressed 72556702 71810632 1.01
clickbench_q26/datafusion:vortex-file-compressed 45930036 44725001 1.03
clickbench_q27/datafusion:vortex-file-compressed 712675568 701411408 1.02
clickbench_q28/datafusion:vortex-file-compressed 6682265349 6624916625 1.01
clickbench_q29/datafusion:vortex-file-compressed 241578698 238596614 1.01
clickbench_q30/datafusion:vortex-file-compressed 220058576 217925532 1.01
clickbench_q31/datafusion:vortex-file-compressed 260628576 253047267 1.03
clickbench_q32/datafusion:vortex-file-compressed 1115253833 1101253593 1.01
clickbench_q33/datafusion:vortex-file-compressed 1312389380 1289956189 1.02
clickbench_q34/datafusion:vortex-file-compressed 1318709016 1283909940 1.03
clickbench_q35/datafusion:vortex-file-compressed 447084542 444324551 1.01
clickbench_q36/datafusion:vortex-file-compressed 69766551 68761882 1.01
clickbench_q37/datafusion:vortex-file-compressed 34669300 33867347 1.02
clickbench_q38/datafusion:vortex-file-compressed 19553377 18137011 1.08
clickbench_q39/datafusion:vortex-file-compressed 132730796 129772052 1.02
clickbench_q40/datafusion:vortex-file-compressed 15867586 15121290 1.05
clickbench_q41/datafusion:vortex-file-compressed 14800270 14596980 1.01
clickbench_q42/datafusion:vortex-file-compressed 16618067 16270499 1.02
datafusion / parquet (1.017x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1551612 1569758 0.99
clickbench_q01/datafusion:parquet 18998884 19981380 0.95
clickbench_q02/datafusion:parquet 46973105 48073012 0.98
clickbench_q03/datafusion:parquet 38765317 37142052 1.04
clickbench_q04/datafusion:parquet 296832644 295321570 1.01
clickbench_q05/datafusion:parquet 357386163 339791015 1.05
clickbench_q06/datafusion:parquet 1629579 1526088 1.07
clickbench_q07/datafusion:parquet 23493441 22276488 1.05
clickbench_q08/datafusion:parquet 368968021 365435810 1.01
clickbench_q09/datafusion:parquet 619080195 590586127 1.05
clickbench_q10/datafusion:parquet 107466095 103938944 1.03
clickbench_q11/datafusion:parquet 130684485 125482764 1.04
clickbench_q12/datafusion:parquet 345393156 340457451 1.01
clickbench_q13/datafusion:parquet 498337648 487656020 1.02
clickbench_q14/datafusion:parquet 344713522 347876059 0.99
clickbench_q15/datafusion:parquet 340893305 332233793 1.03
clickbench_q16/datafusion:parquet 657413200 637626800 1.03
clickbench_q17/datafusion:parquet 651995008 634302631 1.03
clickbench_q18/datafusion:parquet 1322655704 1313310099 1.01
clickbench_q19/datafusion:parquet 30311224 30850585 0.98
clickbench_q20/datafusion:parquet 615759401 603586059 1.02
clickbench_q21/datafusion:parquet 662728241 649895689 1.02
clickbench_q22/datafusion:parquet 953592853 960529798 0.99
clickbench_q23/datafusion:parquet 3678063901 3610595431 1.02
clickbench_q24/datafusion:parquet 83910399 86990633 0.96
clickbench_q25/datafusion:parquet 133531342 129494054 1.03
clickbench_q26/datafusion:parquet 82505522 84555503 0.98
clickbench_q27/datafusion:parquet 1032069991 1049992315 0.98
clickbench_q28/datafusion:parquet 6645245845 6425082516 1.03
clickbench_q29/datafusion:parquet 251164239 228338693 1.10
clickbench_q30/datafusion:parquet 324814606 324745229 1.00
clickbench_q31/datafusion:parquet 363574953 362675248 1.00
clickbench_q32/datafusion:parquet 1235781167 1183451734 1.04
clickbench_q33/datafusion:parquet 1501366446 1478139077 1.02
clickbench_q34/datafusion:parquet 1509182418 1476022554 1.02
clickbench_q35/datafusion:parquet 459925592 455163728 1.01
clickbench_q36/datafusion:parquet 138295647 139267177 0.99
clickbench_q37/datafusion:parquet 57784696 54901215 1.05
clickbench_q38/datafusion:parquet 84333819 83776069 1.01
clickbench_q39/datafusion:parquet 260364267 253168934 1.03
clickbench_q40/datafusion:parquet 31446654 30036237 1.05
clickbench_q41/datafusion:parquet 27227656 26216234 1.04
clickbench_q42/datafusion:parquet 29657462 30755763 0.96
duckdb / vortex-file-compressed (0.986x ➖, 6↑ 2↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6423192 6177475 1.04
clickbench_q01/duckdb:vortex-file-compressed 11881646 11655962 1.02
clickbench_q02/duckdb:vortex-file-compressed 27051353 25455391 1.06
clickbench_q03/duckdb:vortex-file-compressed 30078301 30505387 0.99
clickbench_q04/duckdb:vortex-file-compressed 186266372 186828308 1.00
clickbench_q05/duckdb:vortex-file-compressed 175628682 173673739 1.01
clickbench_q06/duckdb:vortex-file-compressed 20928383 19934891 1.05
clickbench_q07/duckdb:vortex-file-compressed 15141577 14862304 1.02
clickbench_q08/duckdb:vortex-file-compressed 266267713 265385865 1.00
clickbench_q09/duckdb:vortex-file-compressed 341178625 336343825 1.01
clickbench_q10/duckdb:vortex-file-compressed 68534013 67606428 1.01
clickbench_q11/duckdb:vortex-file-compressed 79508788 78661003 1.01
clickbench_q12/duckdb:vortex-file-compressed 202900806 200288708 1.01
clickbench_q13/duckdb:vortex-file-compressed 403467584 406621514 0.99
clickbench_q14/duckdb:vortex-file-compressed 233310255 226896164 1.03
clickbench_q15/duckdb:vortex-file-compressed 241719972 247266413 0.98
clickbench_q16/duckdb:vortex-file-compressed 530760654 519796324 1.02
clickbench_q17/duckdb:vortex-file-compressed 424070118 415306361 1.02
clickbench_q18/duckdb:vortex-file-compressed 942901641 940939770 1.00
clickbench_q19/duckdb:vortex-file-compressed 22185976 21162226 1.05
clickbench_q20/duckdb:vortex-file-compressed 331808187 333170735 1.00
clickbench_q21/duckdb:vortex-file-compressed 365144658 371201534 0.98
clickbench_q22/duckdb:vortex-file-compressed 515620447 560550252 0.92
clickbench_q23/duckdb:vortex-file-compressed 172455539 167122944 1.03
clickbench_q24/duckdb:vortex-file-compressed 🚨 35059643 30544133 1.15
clickbench_q25/duckdb:vortex-file-compressed 75453588 73156670 1.03
clickbench_q26/duckdb:vortex-file-compressed 🚨 48052093 40568575 1.18
clickbench_q27/duckdb:vortex-file-compressed 478000802 472322008 1.01
clickbench_q28/duckdb:vortex-file-compressed 3020548940 3005510456 1.01
clickbench_q29/duckdb:vortex-file-compressed 28293466 29086243 0.97
clickbench_q30/duckdb:vortex-file-compressed 193202313 192889954 1.00
clickbench_q31/duckdb:vortex-file-compressed 283105483 282458780 1.00
clickbench_q32/duckdb:vortex-file-compressed 1133866026 1103471675 1.03
clickbench_q33/duckdb:vortex-file-compressed 1052542538 1038330959 1.01
clickbench_q34/duckdb:vortex-file-compressed 1152303072 1149231023 1.00
clickbench_q35/duckdb:vortex-file-compressed 377447653 372438992 1.01
clickbench_q36/duckdb:vortex-file-compressed 🚀 24121200 28761685 0.84
clickbench_q37/duckdb:vortex-file-compressed 🚀 15684483 20231750 0.78
clickbench_q38/duckdb:vortex-file-compressed 🚀 19118871 22360582 0.86
clickbench_q39/duckdb:vortex-file-compressed 39162826 41812578 0.94
clickbench_q40/duckdb:vortex-file-compressed 🚀 17324129 20559857 0.84
clickbench_q41/duckdb:vortex-file-compressed 🚀 16451790 20383703 0.81
clickbench_q42/duckdb:vortex-file-compressed 🚀 17279016 20888105 0.83
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22522727 22266025 1.01
clickbench_q01/duckdb:parquet 29556718 28495677 1.04
clickbench_q02/duckdb:parquet 49777934 49713460 1.00
clickbench_q03/duckdb:parquet 39003556 39698738 0.98
clickbench_q04/duckdb:parquet 203995693 204648075 1.00
clickbench_q05/duckdb:parquet 256596358 259808307 0.99
clickbench_q06/duckdb:parquet 47226619 46814328 1.01
clickbench_q07/duckdb:parquet 31337268 31411877 1.00
clickbench_q08/duckdb:parquet 269648731 275055265 0.98
clickbench_q09/duckdb:parquet 397057710 398903640 1.00
clickbench_q10/duckdb:parquet 82125053 82000286 1.00
clickbench_q11/duckdb:parquet 99791948 99684640 1.00
clickbench_q12/duckdb:parquet 283800874 279796896 1.01
clickbench_q13/duckdb:parquet 467867689 471086711 0.99
clickbench_q14/duckdb:parquet 318881561 315510137 1.01
clickbench_q15/duckdb:parquet 259112281 252895764 1.02
clickbench_q16/duckdb:parquet 595968919 591085326 1.01
clickbench_q17/duckdb:parquet 498455837 497155623 1.00
clickbench_q18/duckdb:parquet 1044119619 1035266672 1.01
clickbench_q19/duckdb:parquet 28322694 27647405 1.02
clickbench_q20/duckdb:parquet 415981318 412363467 1.01
clickbench_q21/duckdb:parquet 533422831 529581459 1.01
clickbench_q22/duckdb:parquet 918484577 924672860 0.99
clickbench_q23/duckdb:parquet 267000360 268217184 1.00
clickbench_q24/duckdb:parquet 69820244 71771431 0.97
clickbench_q25/duckdb:parquet 163064283 162642554 1.00
clickbench_q26/duckdb:parquet 53544281 52248164 1.02
clickbench_q27/duckdb:parquet 636536140 642813779 0.99
clickbench_q28/duckdb:parquet 4904451043 4866573611 1.01
clickbench_q29/duckdb:parquet 42606589 42770338 1.00
clickbench_q30/duckdb:parquet 317621498 307970543 1.03
clickbench_q31/duckdb:parquet 379424557 373877731 1.01
clickbench_q32/duckdb:parquet 1114264118 1117734635 1.00
clickbench_q33/duckdb:parquet 1113868085 1101540089 1.01
clickbench_q34/duckdb:parquet 1161787856 1147105731 1.01
clickbench_q35/duckdb:parquet 369582049 370330096 1.00
clickbench_q36/duckdb:parquet 46907860 45393910 1.03
clickbench_q37/duckdb:parquet 34499460 34622468 1.00
clickbench_q38/duckdb:parquet 35439176 35634650 0.99
clickbench_q39/duckdb:parquet 81148232 76341885 1.06
clickbench_q40/duckdb:parquet 20078067 19987439 1.00
clickbench_q41/duckdb:parquet 20427337 20497627 1.00
clickbench_q42/duckdb:parquet 22557592 22175854 1.02
duckdb / duckdb (1.001x ➖, 5↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 21143425 17889491 1.18
clickbench_q01/duckdb:duckdb 37113901 35474441 1.05
clickbench_q02/duckdb:duckdb 54275474 54351238 1.00
clickbench_q03/duckdb:duckdb 58313970 57870774 1.01
clickbench_q04/duckdb:duckdb 213429011 222367945 0.96
clickbench_q05/duckdb:duckdb 285275186 296178912 0.96
clickbench_q06/duckdb:duckdb 37357691 36120177 1.03
clickbench_q07/duckdb:duckdb 38137162 37238154 1.02
clickbench_q08/duckdb:duckdb 282188446 283875018 0.99
clickbench_q09/duckdb:duckdb 401688028 394718680 1.02
clickbench_q10/duckdb:duckdb 120109617 116762515 1.03
clickbench_q11/duckdb:duckdb 129616048 125407957 1.03
clickbench_q12/duckdb:duckdb 262919074 260156262 1.01
clickbench_q13/duckdb:duckdb 445804075 443307007 1.01
clickbench_q14/duckdb:duckdb 289412487 284172450 1.02
clickbench_q15/duckdb:duckdb 245622349 241304950 1.02
clickbench_q16/duckdb:duckdb 572913288 558162646 1.03
clickbench_q17/duckdb:duckdb 477695500 476758459 1.00
clickbench_q18/duckdb:duckdb 993900726 994920371 1.00
clickbench_q19/duckdb:duckdb 37367837 34508880 1.08
clickbench_q20/duckdb:duckdb 456573796 459201834 0.99
clickbench_q21/duckdb:duckdb 469400189 477132534 0.98
clickbench_q22/duckdb:duckdb 554573430 541604967 1.02
clickbench_q23/duckdb:duckdb 252173629 246955687 1.02
clickbench_q24/duckdb:duckdb 64011695 62743052 1.02
clickbench_q25/duckdb:duckdb 151580688 149524198 1.01
clickbench_q26/duckdb:duckdb 64448795 61565637 1.05
clickbench_q27/duckdb:duckdb 544312094 545448552 1.00
clickbench_q28/duckdb:duckdb 4517670888 4500181146 1.00
clickbench_q29/duckdb:duckdb 53707325 51679688 1.04
clickbench_q30/duckdb:duckdb 280483201 278868668 1.01
clickbench_q31/duckdb:duckdb 369235845 365555790 1.01
clickbench_q32/duckdb:duckdb 🚀 1121534049 1250640391 0.90
clickbench_q33/duckdb:duckdb 🚀 1119749414 1317591124 0.85
clickbench_q34/duckdb:duckdb 🚀 1201544089 1455497007 0.83
clickbench_q35/duckdb:duckdb 🚀 304676842 346948004 0.88
clickbench_q36/duckdb:duckdb 52244605 53827976 0.97
clickbench_q37/duckdb:duckdb 31837866 30556144 1.04
clickbench_q38/duckdb:duckdb 36373314 35169745 1.03
clickbench_q39/duckdb:duckdb 🚀 89320932 100787654 0.89
clickbench_q40/duckdb:duckdb 30807311 29683787 1.04
clickbench_q41/duckdb:duckdb 30205473 28931034 1.04
clickbench_q42/duckdb:duckdb 32534569 31103489 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +3.7% -0.0% +3.7% +741.6% ➖ noise
0 duckdb:duckdb +18.2% -0.0% +18.2% +274.2% ➖ noise
0 duckdb:vortex-file-compressed +4.0% -0.0% +4.0% +444.6% ➖ noise
1 datafusion:vortex-file-compressed +4.4% -0.7% +5.1% +26.9% ➖ noise
1 duckdb:duckdb +4.6% -0.7% +5.3% +44.2% ➖ noise
1 duckdb:vortex-file-compressed +1.9% -0.7% +2.6% +22.8% ➖ noise
2 datafusion:vortex-file-compressed +0.3% -1.1% +1.4% +14.4% ➖ noise
2 duckdb:duckdb -0.1% -1.1% +1.0% +21.8% ➖ noise
2 duckdb:vortex-file-compressed +6.3% -1.1% +7.4% +11.6% ➖ noise
3 datafusion:vortex-file-compressed +8.0% +1.3% +6.6% +139.5% ➖ noise
3 duckdb:duckdb +0.8% +1.3% -0.5% +36.6% ➖ noise
3 duckdb:vortex-file-compressed -1.4% +1.3% -2.6% +68.9% ➖ noise
4 datafusion:vortex-file-compressed +3.3% +0.1% +3.2% +10.0% ➖ noise
4 duckdb:duckdb -4.0% +0.1% -4.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.3% +0.1% -0.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.2% +1.9% +3.2% +10.0% ➖ noise
5 duckdb:duckdb -3.7% +1.9% -5.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.1% +1.9% -0.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.7% +3.8% -7.2% +73.9% ➖ noise
6 duckdb:duckdb +3.4% +3.8% -0.3% +18.5% ➖ noise
6 duckdb:vortex-file-compressed +5.0% +3.8% +1.2% +20.5% ➖ noise
7 datafusion:vortex-file-compressed +1.7% +2.6% -0.9% +14.7% ➖ noise
7 duckdb:duckdb +2.4% +2.6% -0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% +2.6% -0.7% +15.2% ➖ noise
8 datafusion:vortex-file-compressed +1.9% -0.5% +2.5% +10.0% ➖ noise
8 duckdb:duckdb -0.6% -0.5% -0.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.3% -0.5% +0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.7% +2.1% -1.4% +10.0% ➖ noise
9 duckdb:duckdb +1.8% +2.1% -0.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.4% +2.1% -0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.8% +1.8% +1.0% +10.0% ➖ noise
10 duckdb:duckdb +2.9% +1.8% +1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.4% +1.8% -0.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.8% +2.1% +2.7% +10.0% ➖ noise
11 duckdb:duckdb +3.4% +2.1% +1.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +1.1% +2.1% -1.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.4% +1.4% +1.0% +10.0% ➖ noise
12 duckdb:duckdb +1.1% +1.4% -0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.3% +1.4% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.7% +0.7% +1.0% +10.0% ➖ noise
13 duckdb:duckdb +0.6% +0.7% -0.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.8% +0.7% -1.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +4.4% +0.1% +4.3% +10.0% ➖ noise
14 duckdb:duckdb +1.8% +0.1% +1.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.8% +0.1% +2.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.7% +2.5% +0.2% +10.0% ➖ noise
15 duckdb:duckdb +1.8% +2.5% -0.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -2.2% +2.5% -4.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.6% +2.0% +1.6% +10.0% ➖ noise
16 duckdb:duckdb +2.6% +2.0% +0.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.1% +2.0% +0.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.7% +1.5% +1.2% +10.0% ➖ noise
17 duckdb:duckdb +0.2% +1.5% -1.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.1% +1.5% +0.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.4% +0.8% +0.6% +10.0% ➖ noise
18 duckdb:duckdb -0.1% +0.8% -0.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.2% +0.8% -0.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.6% +0.3% -3.9% +27.5% ➖ noise
19 duckdb:duckdb +8.3% +0.3% +7.9% +14.7% ➖ noise
19 duckdb:vortex-file-compressed +4.8% +0.3% +4.5% +19.7% ➖ noise
20 datafusion:vortex-file-compressed +0.5% +1.4% -0.9% +205.1% ➖ noise
20 duckdb:duckdb -0.6% +1.4% -2.0% +73.9% ➖ noise
20 duckdb:vortex-file-compressed -0.4% +1.4% -1.8% +62.7% ➖ noise
21 datafusion:vortex-file-compressed +3.3% +1.3% +1.9% +10.0% ➖ noise
21 duckdb:duckdb -1.6% +1.3% -2.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.6% +1.3% -2.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.7% -0.7% +2.4% +13.4% ➖ noise
22 duckdb:duckdb +2.4% -0.7% +3.1% +35.4% ➖ noise
22 duckdb:vortex-file-compressed -8.0% -0.7% -7.4% +18.4% ➖ noise
23 datafusion:vortex-file-compressed +10.6% +0.7% +9.8% +53.9% ➖ noise
23 duckdb:duckdb +2.1% +0.7% +1.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +3.2% +0.7% +2.5% +26.2% ➖ noise
24 datafusion:vortex-file-compressed -6.3% -3.1% -3.3% +10.1% ➖ noise
24 duckdb:duckdb +2.0% -3.1% +5.3% +28.9% ➖ noise
24 duckdb:vortex-file-compressed +14.8% -3.1% +18.5% +14.6% 🚨 regression
25 datafusion:vortex-file-compressed +1.0% +1.7% -0.6% +10.0% ➖ noise
25 duckdb:duckdb +1.4% +1.7% -0.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.1% +1.7% +1.4% +10.2% ➖ noise
26 datafusion:vortex-file-compressed +2.7% -0.0% +2.7% +10.0% ➖ noise
26 duckdb:duckdb +4.7% -0.0% +4.7% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +18.4% -0.0% +18.4% +16.1% 🚨 regression
27 datafusion:vortex-file-compressed +1.6% -1.3% +3.0% +10.0% ➖ noise
27 duckdb:duckdb -0.2% -1.3% +1.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +1.2% -1.3% +2.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.9% +2.1% -1.2% +10.0% ➖ noise
28 duckdb:duckdb +0.4% +2.1% -1.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.5% +2.1% -1.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.2% +4.7% -3.3% +12.3% ➖ noise
29 duckdb:duckdb +3.9% +4.7% -0.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -2.7% +4.7% -7.1% +25.3% ➖ noise
30 datafusion:vortex-file-compressed +1.0% +1.6% -0.6% +10.0% ➖ noise
30 duckdb:duckdb +0.6% +1.6% -1.0% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.2% +1.6% -1.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +3.0% +0.9% +2.1% +10.0% ➖ noise
31 duckdb:duckdb +1.0% +0.9% +0.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.2% +0.9% -0.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.3% +2.0% -0.7% +10.0% ➖ noise
32 duckdb:duckdb -10.3% +2.0% -12.1% +10.0% ✅ faster
32 duckdb:vortex-file-compressed +2.8% +2.0% +0.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.7% +1.3% +0.4% +10.0% ➖ noise
33 duckdb:duckdb -15.0% +1.3% -16.1% +10.0% ✅ faster
33 duckdb:vortex-file-compressed +1.4% +1.3% +0.0% +17.9% ➖ noise
34 datafusion:vortex-file-compressed +2.7% +1.8% +0.9% +10.0% ➖ noise
34 duckdb:duckdb -17.4% +1.8% -18.9% +10.0% ✅ faster
34 duckdb:vortex-file-compressed +0.3% +1.8% -1.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.6% +0.4% +0.2% +10.0% ➖ noise
35 duckdb:duckdb -12.2% +0.4% -12.6% +10.0% ✅ faster
35 duckdb:vortex-file-compressed +1.3% +0.4% +0.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.5% +1.3% +0.2% +10.0% ➖ noise
36 duckdb:duckdb -2.9% +1.3% -4.2% +12.9% ➖ noise
36 duckdb:vortex-file-compressed -16.1% +1.3% -17.2% +10.0% ✅ faster
37 datafusion:vortex-file-compressed +2.4% +2.4% -0.0% +10.0% ➖ noise
37 duckdb:duckdb +4.2% +2.4% +1.7% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -22.5% +2.4% -24.3% +14.5% ✅ faster
38 datafusion:vortex-file-compressed +7.8% +0.1% +7.7% +10.2% ➖ noise
38 duckdb:duckdb +3.4% +0.1% +3.4% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -14.5% +0.1% -14.5% +10.2% ✅ faster
39 datafusion:vortex-file-compressed +2.3% +4.6% -2.2% +10.0% ➖ noise
39 duckdb:duckdb -11.4% +4.6% -15.2% +18.4% ➖ noise
39 duckdb:vortex-file-compressed -6.3% +4.6% -10.4% +10.0% ✅ faster
40 datafusion:vortex-file-compressed +4.9% +2.6% +2.3% +10.0% ➖ noise
40 duckdb:duckdb +3.8% +2.6% +1.2% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -15.7% +2.6% -17.8% +11.4% ✅ faster
41 datafusion:vortex-file-compressed +1.4% +1.7% -0.3% +10.0% ➖ noise
41 duckdb:duckdb +4.4% +1.7% +2.6% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -19.3% +1.7% -20.7% +10.8% ✅ faster
42 datafusion:vortex-file-compressed +2.1% -1.0% +3.1% +10.0% ➖ noise
42 duckdb:duckdb +4.6% -1.0% +5.6% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -17.3% -1.0% -16.5% +15.4% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, -0.0% overall, 0↑ 201↓)
File Scale Format Base HEAD Change %
hits_51.vortex 1.0 vortex-file-compressed 428.84 MB 428.84 MB 32 B -0.0%
hits_54.vortex 1.0 vortex-file-compressed 361.83 MB 361.83 MB 32 B -0.0%
hits_43.vortex 1.0 vortex-file-compressed 305.71 MB 305.71 MB 32 B -0.0%
hits_41.vortex 1.0 vortex-file-compressed 300.49 MB 300.49 MB 32 B -0.0%
hits_42.vortex 1.0 vortex-file-compressed 298.79 MB 298.79 MB 32 B -0.0%
hits_89.vortex 1.0 vortex-file-compressed 266.01 MB 266.01 MB 32 B -0.0%
hits_67.vortex 1.0 vortex-file-compressed 265.94 MB 265.94 MB 32 B -0.0%
hits_50.vortex 1.0 vortex-file-compressed 255.24 MB 255.24 MB 32 B -0.0%
hits_55.vortex 1.0 vortex-file-compressed 251.56 MB 251.56 MB 32 B -0.0%
hits_44.vortex 1.0 vortex-file-compressed 243.64 MB 243.64 MB 32 B -0.0%
hits_2.vortex 1.0 vortex-file-compressed 241.46 MB 241.46 MB 32 B -0.0%
hits_78.vortex 1.0 vortex-file-compressed 238.59 MB 238.59 MB 32 B -0.0%
hits_65.vortex 1.0 vortex-file-compressed 238.05 MB 238.05 MB 32 B -0.0%
hits_87.vortex 1.0 vortex-file-compressed 221.68 MB 221.68 MB 32 B -0.0%
hits_77.vortex 1.0 vortex-file-compressed 218.96 MB 218.96 MB 32 B -0.0%
hits_79.vortex 1.0 vortex-file-compressed 204.16 MB 204.16 MB 32 B -0.0%
hits_90.vortex 1.0 vortex-file-compressed 204.12 MB 204.12 MB 32 B -0.0%
hits_92.vortex 1.0 vortex-file-compressed 196.47 MB 196.47 MB 32 B -0.0%
hits_3.vortex 1.0 vortex-file-compressed 193.11 MB 193.11 MB 32 B -0.0%
hits_94.vortex 1.0 vortex-file-compressed 185.12 MB 185.12 MB 32 B -0.0%
hits_1.vortex 1.0 vortex-file-compressed 181.16 MB 181.16 MB 32 B -0.0%
hits_96.vortex 1.0 vortex-file-compressed 180.76 MB 180.76 MB 32 B -0.0%
hits_27.vortex 1.0 vortex-file-compressed 174.61 MB 174.61 MB 32 B -0.0%
hits_68.vortex 1.0 vortex-file-compressed 172.16 MB 172.16 MB 32 B -0.0%
hits_43.vortex 1.0 vortex-compact 168.91 MB 168.91 MB 32 B -0.0%
hits_51.vortex 1.0 vortex-compact 167.81 MB 167.81 MB 32 B -0.0%
hits_28.vortex 1.0 vortex-file-compressed 167.55 MB 167.55 MB 32 B -0.0%
hits_41.vortex 1.0 vortex-compact 165.78 MB 165.78 MB 32 B -0.0%
hits_42.vortex 1.0 vortex-compact 164.22 MB 164.22 MB 32 B -0.0%
hits_56.vortex 1.0 vortex-file-compressed 163.76 MB 163.76 MB 32 B -0.0%
hits_99.vortex 1.0 vortex-file-compressed 158.88 MB 158.88 MB 32 B -0.0%
hits_57.vortex 1.0 vortex-file-compressed 158.37 MB 158.37 MB 32 B -0.0%
hits_74.vortex 1.0 vortex-file-compressed 152.12 MB 152.12 MB 32 B -0.0%
hits_98.vortex 1.0 vortex-file-compressed 150.55 MB 150.55 MB 32 B -0.0%
hits_62.vortex 1.0 vortex-file-compressed 148.36 MB 148.36 MB 32 B -0.0%
hits_69.vortex 1.0 vortex-file-compressed 147.61 MB 147.61 MB 32 B -0.0%
hits_45.vortex 1.0 vortex-file-compressed 145.48 MB 145.48 MB 32 B -0.0%
hits_84.vortex 1.0 vortex-file-compressed 145.05 MB 145.05 MB 32 B -0.0%
hits_26.vortex 1.0 vortex-file-compressed 144.05 MB 144.05 MB 32 B -0.0%
hits_40.vortex 1.0 vortex-file-compressed 142.99 MB 142.99 MB 32 B -0.0%
hits_76.vortex 1.0 vortex-file-compressed 140.05 MB 140.05 MB 32 B -0.0%
hits_4.vortex 1.0 vortex-file-compressed 138.86 MB 138.86 MB 32 B -0.0%
hits_35.vortex 1.0 vortex-file-compressed 138.81 MB 138.81 MB 32 B -0.0%
hits_88.vortex 1.0 vortex-file-compressed 137.34 MB 137.34 MB 32 B -0.0%
hits_25.vortex 1.0 vortex-file-compressed 137.01 MB 137.01 MB 32 B -0.0%
hits_14.vortex 1.0 vortex-file-compressed 135.14 MB 135.14 MB 32 B -0.0%
hits_44.vortex 1.0 vortex-compact 132.46 MB 132.46 MB 32 B -0.0%
hits_73.vortex 1.0 vortex-file-compressed 131.83 MB 131.83 MB 32 B -0.0%
hits_97.vortex 1.0 vortex-file-compressed 130.96 MB 130.96 MB 32 B -0.0%
hits_65.vortex 1.0 vortex-compact 129.95 MB 129.95 MB 32 B -0.0%
hits_2.vortex 1.0 vortex-compact 129.36 MB 129.36 MB 32 B -0.0%
hits_81.vortex 1.0 vortex-file-compressed 126.55 MB 126.55 MB 32 B -0.0%
hits_71.vortex 1.0 vortex-file-compressed 126.41 MB 126.41 MB 32 B -0.0%
hits_18.vortex 1.0 vortex-file-compressed 126.06 MB 126.06 MB 32 B -0.0%
hits_12.vortex 1.0 vortex-file-compressed 125.34 MB 125.34 MB 32 B -0.0%
hits_80.vortex 1.0 vortex-file-compressed 124.24 MB 124.24 MB 32 B -0.0%
hits_9.vortex 1.0 vortex-file-compressed 124.22 MB 124.22 MB 32 B -0.0%
hits_7.vortex 1.0 vortex-file-compressed 123.82 MB 123.82 MB 32 B -0.0%
hits_13.vortex 1.0 vortex-file-compressed 123.20 MB 123.20 MB 32 B -0.0%
hits_6.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 32 B -0.0%
hits_8.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 32 B -0.0%
hits_82.vortex 1.0 vortex-file-compressed 122.77 MB 122.77 MB 32 B -0.0%
hits_5.vortex 1.0 vortex-file-compressed 122.64 MB 122.64 MB 32 B -0.0%
hits_59.vortex 1.0 vortex-file-compressed 121.84 MB 121.84 MB 32 B -0.0%
hits_60.vortex 1.0 vortex-file-compressed 121.19 MB 121.19 MB 32 B -0.0%
hits_52.vortex 1.0 vortex-file-compressed 120.78 MB 120.78 MB 32 B -0.0%
hits_87.vortex 1.0 vortex-compact 119.04 MB 119.04 MB 32 B -0.0%
hits_38.vortex 1.0 vortex-file-compressed 118.43 MB 118.43 MB 32 B -0.0%
hits_77.vortex 1.0 vortex-compact 118.11 MB 118.11 MB 32 B -0.0%
hits_54.vortex 1.0 vortex-compact 117.66 MB 117.66 MB 32 B -0.0%
hits_91.vortex 1.0 vortex-file-compressed 116.23 MB 116.23 MB 32 B -0.0%
hits_70.vortex 1.0 vortex-file-compressed 115.14 MB 115.14 MB 32 B -0.0%
hits_61.vortex 1.0 vortex-file-compressed 114.43 MB 114.43 MB 32 B -0.0%
hits_95.vortex 1.0 vortex-file-compressed 114.33 MB 114.33 MB 32 B -0.0%
hits_67.vortex 1.0 vortex-compact 114.05 MB 114.05 MB 32 B -0.0%
hits_58.vortex 1.0 vortex-file-compressed 113.78 MB 113.78 MB 32 B -0.0%
hits_50.vortex 1.0 vortex-compact 113.12 MB 113.12 MB 32 B -0.0%
hits_89.vortex 1.0 vortex-compact 112.82 MB 112.82 MB 32 B -0.0%
hits_0.vortex 1.0 vortex-file-compressed 112.17 MB 112.17 MB 32 B -0.0%
hits_34.vortex 1.0 vortex-file-compressed 111.68 MB 111.68 MB 32 B -0.0%
hits_93.vortex 1.0 vortex-file-compressed 107.66 MB 107.66 MB 32 B -0.0%
hits_85.vortex 1.0 vortex-file-compressed 106.37 MB 106.37 MB 32 B -0.0%
hits_66.vortex 1.0 vortex-file-compressed 105.34 MB 105.34 MB 32 B -0.0%
hits_31.vortex 1.0 vortex-file-compressed 104.39 MB 104.39 MB 32 B -0.0%
hits_30.vortex 1.0 vortex-file-compressed 104.00 MB 104.00 MB 32 B -0.0%
hits_83.vortex 1.0 vortex-file-compressed 103.72 MB 103.72 MB 32 B -0.0%
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 103.64 MB 32 B -0.0%
hits_21.vortex 1.0 vortex-file-compressed 101.28 MB 101.28 MB 32 B -0.0%
hits_53.vortex 1.0 vortex-file-compressed 98.26 MB 98.26 MB 32 B -0.0%
hits_78.vortex 1.0 vortex-compact 97.87 MB 97.87 MB 32 B -0.0%
hits_37.vortex 1.0 vortex-file-compressed 97.54 MB 97.54 MB 32 B -0.0%
hits_15.vortex 1.0 vortex-file-compressed 97.01 MB 97.01 MB 32 B -0.0%
hits_72.vortex 1.0 vortex-file-compressed 96.27 MB 96.27 MB 32 B -0.0%
hits_11.vortex 1.0 vortex-file-compressed 96.07 MB 96.07 MB 32 B -0.0%
hits_64.vortex 1.0 vortex-file-compressed 95.27 MB 95.27 MB 32 B -0.0%
hits_92.vortex 1.0 vortex-compact 94.27 MB 94.27 MB 32 B -0.0%
hits_3.vortex 1.0 vortex-compact 94.23 MB 94.23 MB 32 B -0.0%
hits_39.vortex 1.0 vortex-file-compressed 94.06 MB 94.06 MB 32 B -0.0%
hits_55.vortex 1.0 vortex-compact 93.77 MB 93.77 MB 32 B -0.0%
hits_96.vortex 1.0 vortex-compact 91.08 MB 91.08 MB 32 B -0.0%
hits_94.vortex 1.0 vortex-compact 90.63 MB 90.63 MB 32 B -0.0%
hits_1.vortex 1.0 vortex-compact 90.34 MB 90.34 MB 32 B -0.0%
hits_49.vortex 1.0 vortex-file-compressed 88.67 MB 88.67 MB 32 B -0.0%
hits_16.vortex 1.0 vortex-file-compressed 87.59 MB 87.59 MB 32 B -0.0%
hits_79.vortex 1.0 vortex-compact 85.70 MB 85.70 MB 32 B -0.0%
hits_57.vortex 1.0 vortex-compact 83.54 MB 83.54 MB 32 B -0.0%
hits_19.vortex 1.0 vortex-file-compressed 82.10 MB 82.10 MB 32 B -0.0%
hits_90.vortex 1.0 vortex-compact 81.86 MB 81.86 MB 32 B -0.0%
hits_10.vortex 1.0 vortex-file-compressed 81.76 MB 81.76 MB 32 B -0.0%
hits_86.vortex 1.0 vortex-file-compressed 81.40 MB 81.40 MB 32 B -0.0%
hits_22.vortex 1.0 vortex-file-compressed 81.17 MB 81.17 MB 32 B -0.0%
hits_69.vortex 1.0 vortex-compact 81.02 MB 81.02 MB 32 B -0.0%
hits_63.vortex 1.0 vortex-file-compressed 80.62 MB 80.62 MB 32 B -0.0%
hits_23.vortex 1.0 vortex-file-compressed 80.37 MB 80.37 MB 32 B -0.0%
hits_46.vortex 1.0 vortex-file-compressed 80.32 MB 80.32 MB 32 B -0.0%
hits_36.vortex 1.0 vortex-file-compressed 80.27 MB 80.27 MB 32 B -0.0%
hits_24.vortex 1.0 vortex-file-compressed 79.71 MB 79.71 MB 32 B -0.0%
hits_56.vortex 1.0 vortex-compact 77.87 MB 77.87 MB 32 B -0.0%
hits_99.vortex 1.0 vortex-compact 77.31 MB 77.31 MB 32 B -0.0%
hits_32.vortex 1.0 vortex-file-compressed 77.12 MB 77.12 MB 32 B -0.0%
hits_76.vortex 1.0 vortex-compact 76.44 MB 76.44 MB 32 B -0.0%
hits_45.vortex 1.0 vortex-compact 76.07 MB 76.07 MB 32 B -0.0%
hits_68.vortex 1.0 vortex-compact 75.99 MB 75.99 MB 32 B -0.0%
hits_40.vortex 1.0 vortex-compact 75.92 MB 75.92 MB 32 B -0.0%
hits_35.vortex 1.0 vortex-compact 75.11 MB 75.11 MB 32 B -0.0%
hits_62.vortex 1.0 vortex-compact 74.26 MB 74.26 MB 32 B -0.0%
hits_75.vortex 1.0 vortex-file-compressed 74.18 MB 74.18 MB 32 B -0.0%
hits_14.vortex 1.0 vortex-compact 73.75 MB 73.75 MB 32 B -0.0%
hits_88.vortex 1.0 vortex-compact 73.31 MB 73.31 MB 32 B -0.0%
hits_84.vortex 1.0 vortex-compact 73.14 MB 73.14 MB 32 B -0.0%
hits_25.vortex 1.0 vortex-compact 73.14 MB 73.14 MB 32 B -0.0%
hits_98.vortex 1.0 vortex-compact 72.77 MB 72.77 MB 32 B -0.0%
hits_4.vortex 1.0 vortex-compact 71.81 MB 71.81 MB 32 B -0.0%
hits_74.vortex 1.0 vortex-compact 71.62 MB 71.62 MB 32 B -0.0%
hits_26.vortex 1.0 vortex-compact 70.89 MB 70.89 MB 32 B -0.0%
hits_28.vortex 1.0 vortex-compact 70.27 MB 70.27 MB 32 B -0.0%
hits_73.vortex 1.0 vortex-compact 70.04 MB 70.04 MB 32 B -0.0%
hits_27.vortex 1.0 vortex-compact 69.88 MB 69.88 MB 32 B -0.0%
hits_71.vortex 1.0 vortex-compact 69.29 MB 69.29 MB 32 B -0.0%
hits_12.vortex 1.0 vortex-compact 69.27 MB 69.27 MB 32 B -0.0%
hits_97.vortex 1.0 vortex-compact 69.16 MB 69.16 MB 32 B -0.0%
hits_80.vortex 1.0 vortex-compact 68.07 MB 68.07 MB 32 B -0.0%
hits_13.vortex 1.0 vortex-compact 67.96 MB 67.96 MB 32 B -0.0%
hits_20.vortex 1.0 vortex-file-compressed 67.53 MB 67.53 MB 32 B -0.0%
hits_82.vortex 1.0 vortex-compact 66.89 MB 66.89 MB 32 B -0.0%
hits_59.vortex 1.0 vortex-compact 66.30 MB 66.30 MB 32 B -0.0%
hits_9.vortex 1.0 vortex-compact 65.67 MB 65.67 MB 32 B -0.0%
hits_29.vortex 1.0 vortex-file-compressed 65.47 MB 65.47 MB 32 B -0.0%
hits_81.vortex 1.0 vortex-compact 65.45 MB 65.45 MB 32 B -0.0%
hits_60.vortex 1.0 vortex-compact 64.33 MB 64.33 MB 32 B -0.0%
hits_18.vortex 1.0 vortex-compact 64.28 MB 64.28 MB 32 B -0.0%
hits_7.vortex 1.0 vortex-compact 63.80 MB 63.80 MB 32 B -0.0%
hits_52.vortex 1.0 vortex-compact 63.73 MB 63.73 MB 32 B -0.0%
hits_6.vortex 1.0 vortex-compact 63.16 MB 63.16 MB 32 B -0.0%
hits_38.vortex 1.0 vortex-compact 63.10 MB 63.10 MB 32 B -0.0%
hits_33.vortex 1.0 vortex-file-compressed 62.97 MB 62.97 MB 32 B -0.0%
hits_5.vortex 1.0 vortex-compact 62.90 MB 62.90 MB 32 B -0.0%
hits_8.vortex 1.0 vortex-compact 62.89 MB 62.89 MB 32 B -0.0%
hits_70.vortex 1.0 vortex-compact 61.29 MB 61.29 MB 32 B -0.0%
hits_91.vortex 1.0 vortex-compact 60.94 MB 60.94 MB 32 B -0.0%
hits_58.vortex 1.0 vortex-compact 60.41 MB 60.41 MB 32 B -0.0%
hits_53.vortex 1.0 vortex-compact 59.09 MB 59.09 MB 32 B -0.0%
hits_93.vortex 1.0 vortex-compact 58.90 MB 58.90 MB 32 B -0.0%
hits_30.vortex 1.0 vortex-compact 58.69 MB 58.69 MB 32 B -0.0%
hits_0.vortex 1.0 vortex-compact 58.66 MB 58.66 MB 32 B -0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB 32 B -0.0%
hits_34.vortex 1.0 vortex-compact 58.26 MB 58.26 MB 32 B -0.0%
hits_95.vortex 1.0 vortex-compact 57.75 MB 57.75 MB 32 B -0.0%
hits_61.vortex 1.0 vortex-compact 57.66 MB 57.66 MB 32 B -0.0%
hits_31.vortex 1.0 vortex-compact 55.56 MB 55.56 MB 32 B -0.0%
hits_11.vortex 1.0 vortex-compact 54.35 MB 54.35 MB 32 B -0.0%
hits_64.vortex 1.0 vortex-compact 53.91 MB 53.91 MB 32 B -0.0%
hits_37.vortex 1.0 vortex-compact 53.83 MB 53.83 MB 32 B -0.0%
hits_66.vortex 1.0 vortex-compact 53.49 MB 53.49 MB 32 B -0.0%
hits_85.vortex 1.0 vortex-compact 52.73 MB 52.73 MB 32 B -0.0%
hits_83.vortex 1.0 vortex-compact 52.57 MB 52.57 MB 32 B -0.0%
hits_72.vortex 1.0 vortex-compact 51.79 MB 51.79 MB 32 B -0.0%
hits_21.vortex 1.0 vortex-compact 51.60 MB 51.60 MB 32 B -0.0%
hits_49.vortex 1.0 vortex-compact 50.53 MB 50.53 MB 32 B -0.0%
hits_39.vortex 1.0 vortex-compact 49.82 MB 49.82 MB 32 B -0.0%
hits_36.vortex 1.0 vortex-compact 48.99 MB 48.99 MB 32 B -0.0%
hits_10.vortex 1.0 vortex-compact 48.86 MB 48.86 MB 32 B -0.0%
hits_16.vortex 1.0 vortex-compact 48.30 MB 48.30 MB 32 B -0.0%
hits_86.vortex 1.0 vortex-compact 48.25 MB 48.25 MB 32 B -0.0%
hits_15.vortex 1.0 vortex-compact 48.14 MB 48.14 MB 32 B -0.0%
hits_63.vortex 1.0 vortex-compact 46.10 MB 46.10 MB 32 B -0.0%
hits_19.vortex 1.0 vortex-compact 44.88 MB 44.88 MB 32 B -0.0%
hits_22.vortex 1.0 vortex-compact 44.74 MB 44.74 MB 32 B -0.0%
hits_23.vortex 1.0 vortex-compact 44.17 MB 44.17 MB 32 B -0.0%
hits_32.vortex 1.0 vortex-compact 44.13 MB 44.13 MB 32 B -0.0%
hits_24.vortex 1.0 vortex-compact 43.63 MB 43.63 MB 32 B -0.0%
hits_75.vortex 1.0 vortex-compact 43.63 MB 43.63 MB 32 B -0.0%
hits_46.vortex 1.0 vortex-compact 41.92 MB 41.92 MB 32 B -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.86 MB 41.86 MB 32 B -0.0%
hits_20.vortex 1.0 vortex-compact 38.14 MB 38.14 MB 32 B -0.0%
hits_29.vortex 1.0 vortex-compact 36.61 MB 36.61 MB 32 B -0.0%
hits_33.vortex 1.0 vortex-compact 35.95 MB 35.95 MB 32 B -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.53 MB 28.53 MB 32 B -0.0%
hits_47.vortex 1.0 vortex-compact 18.25 MB 18.25 MB 32 B -0.0%
hits_48.vortex 1.0 vortex-compact 17.32 MB 17.32 MB 32 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.3%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 1.062x ➖
Shifts: Parquet (control) +6.2% · Median polish +3.0%

datafusion / vortex-file-compressed (1.065x ➖, 1↑ 3↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 258849782 239257507 1.08
tpch_q02/datafusion:vortex-file-compressed 454357292 485549663 0.94
tpch_q03/datafusion:vortex-file-compressed 428831750 426896625 1.00
tpch_q04/datafusion:vortex-file-compressed 260763807 284711952 0.92
tpch_q05/datafusion:vortex-file-compressed 447913640 463847231 0.97
tpch_q06/datafusion:vortex-file-compressed 346062596 344278353 1.01
tpch_q07/datafusion:vortex-file-compressed 500155576 433784075 1.15
tpch_q08/datafusion:vortex-file-compressed 748982243 657538893 1.14
tpch_q09/datafusion:vortex-file-compressed 🚨 585141203 417709036 1.40
tpch_q10/datafusion:vortex-file-compressed 631311787 488798618 1.29
tpch_q11/datafusion:vortex-file-compressed 350358567 313681594 1.12
tpch_q12/datafusion:vortex-file-compressed 482619957 418821665 1.15
tpch_q13/datafusion:vortex-file-compressed 162690858 189635897 0.86
tpch_q14/datafusion:vortex-file-compressed 🚨 414523470 272054006 1.52
tpch_q15/datafusion:vortex-file-compressed 504976797 456498514 1.11
tpch_q16/datafusion:vortex-file-compressed 🚨 291982902 213938904 1.36
tpch_q17/datafusion:vortex-file-compressed 428237127 407294508 1.05
tpch_q18/datafusion:vortex-file-compressed 387300759 346054855 1.12
tpch_q19/datafusion:vortex-file-compressed 485588021 520501982 0.93
tpch_q20/datafusion:vortex-file-compressed 450224027 445941076 1.01
tpch_q21/datafusion:vortex-file-compressed 672816654 646699276 1.04
tpch_q22/datafusion:vortex-file-compressed 🚀 119163978 187190166 0.64
datafusion / vortex-compact (0.863x ➖, 3↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 276814180 356033236 0.78
tpch_q02/datafusion:vortex-compact 459390271 472696481 0.97
tpch_q03/datafusion:vortex-compact 360343318 385324261 0.94
tpch_q04/datafusion:vortex-compact 230315166 265173385 0.87
tpch_q05/datafusion:vortex-compact 413398571 429873845 0.96
tpch_q06/datafusion:vortex-compact 283468344 343743219 0.82
tpch_q07/datafusion:vortex-compact 478254684 487871634 0.98
tpch_q08/datafusion:vortex-compact 555555759 650485192 0.85
tpch_q09/datafusion:vortex-compact 405082973 450001145 0.90
tpch_q10/datafusion:vortex-compact 450781914 520024259 0.87
tpch_q11/datafusion:vortex-compact 269964518 298262284 0.91
tpch_q12/datafusion:vortex-compact 409839447 526704641 0.78
tpch_q13/datafusion:vortex-compact 🚀 125132809 191036858 0.66
tpch_q14/datafusion:vortex-compact 213069358 284590334 0.75
tpch_q15/datafusion:vortex-compact 398380237 387563769 1.03
tpch_q16/datafusion:vortex-compact 171552624 194058072 0.88
tpch_q17/datafusion:vortex-compact 🚀 349428213 527183087 0.66
tpch_q18/datafusion:vortex-compact 🚀 285093275 435263200 0.65
tpch_q19/datafusion:vortex-compact 549789818 686983597 0.80
tpch_q20/datafusion:vortex-compact 453589485 447108918 1.01
tpch_q21/datafusion:vortex-compact 526178668 520635231 1.01
tpch_q22/datafusion:vortex-compact 117941877 107697230 1.10
datafusion / parquet (1.092x ➖, 0↑ 5↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 227679174 237562490 0.96
tpch_q02/datafusion:parquet 541716374 456412061 1.19
tpch_q03/datafusion:parquet 🚨 564277367 405854438 1.39
tpch_q04/datafusion:parquet 🚨 279989372 208010874 1.35
tpch_q05/datafusion:parquet 503338240 639826474 0.79
tpch_q06/datafusion:parquet 227139166 207453331 1.09
tpch_q07/datafusion:parquet 611469845 612929262 1.00
tpch_q08/datafusion:parquet 627836518 636974917 0.99
tpch_q09/datafusion:parquet 560648888 446324778 1.26
tpch_q10/datafusion:parquet 🚨 678189620 501438303 1.35
tpch_q11/datafusion:parquet 324258441 362370104 0.89
tpch_q12/datafusion:parquet 🚨 343540923 263938630 1.30
tpch_q13/datafusion:parquet 479114565 435915117 1.10
tpch_q14/datafusion:parquet 🚨 264170026 196720890 1.34
tpch_q15/datafusion:parquet 361997893 317205351 1.14
tpch_q16/datafusion:parquet 179180807 179469222 1.00
tpch_q17/datafusion:parquet 444761719 378867516 1.17
tpch_q18/datafusion:parquet 456816421 458040081 1.00
tpch_q19/datafusion:parquet 340688352 365434866 0.93
tpch_q20/datafusion:parquet 320483790 306805321 1.04
tpch_q21/datafusion:parquet 522347809 521468254 1.00
tpch_q22/datafusion:parquet 121749989 119404971 1.02
duckdb / vortex-file-compressed (1.020x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 287463403 313239748 0.92
tpch_q02/duckdb:vortex-file-compressed 968899687 963707600 1.01
tpch_q03/duckdb:vortex-file-compressed 685131024 742034959 0.92
tpch_q04/duckdb:vortex-file-compressed 424257154 420491445 1.01
tpch_q05/duckdb:vortex-file-compressed 796096666 864341988 0.92
tpch_q06/duckdb:vortex-file-compressed 338017807 429993899 0.79
tpch_q07/duckdb:vortex-file-compressed 1019183520 896859713 1.14
tpch_q08/duckdb:vortex-file-compressed 1092546323 1038900092 1.05
tpch_q09/duckdb:vortex-file-compressed 1093915478 903155050 1.21
tpch_q10/duckdb:vortex-file-compressed 882314033 849296211 1.04
tpch_q11/duckdb:vortex-file-compressed 610584575 518284154 1.18
tpch_q12/duckdb:vortex-file-compressed 729448268 646969335 1.13
tpch_q13/duckdb:vortex-file-compressed 465902876 491105352 0.95
tpch_q14/duckdb:vortex-file-compressed 458399021 440922109 1.04
tpch_q15/duckdb:vortex-file-compressed 328256821 295192723 1.11
tpch_q16/duckdb:vortex-file-compressed 370976330 319113281 1.16
tpch_q17/duckdb:vortex-file-compressed 809674904 827769865 0.98
tpch_q18/duckdb:vortex-file-compressed 712916692 593584064 1.20
tpch_q19/duckdb:vortex-file-compressed 471716174 526044219 0.90
tpch_q20/duckdb:vortex-file-compressed 789221643 780010226 1.01
tpch_q21/duckdb:vortex-file-compressed 1058701784 996079631 1.06
tpch_q22/duckdb:vortex-file-compressed 266741435 312557741 0.85
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 362108600 310696720 1.17
tpch_q02/duckdb:vortex-compact 952771847 1027278110 0.93
tpch_q03/duckdb:vortex-compact 648851855 596295278 1.09
tpch_q04/duckdb:vortex-compact 406516395 423525130 0.96
tpch_q05/duckdb:vortex-compact 799615066 827978195 0.97
tpch_q06/duckdb:vortex-compact 439457286 353796476 1.24
tpch_q07/duckdb:vortex-compact 891868373 973347112 0.92
tpch_q08/duckdb:vortex-compact 937678105 1016274497 0.92
tpch_q09/duckdb:vortex-compact 912763647 985377527 0.93
tpch_q10/duckdb:vortex-compact 702231275 777120635 0.90
tpch_q11/duckdb:vortex-compact 467825821 519258725 0.90
tpch_q12/duckdb:vortex-compact 649800236 554511182 1.17
tpch_q13/duckdb:vortex-compact 445869721 459249003 0.97
tpch_q14/duckdb:vortex-compact 407336185 398827358 1.02
tpch_q15/duckdb:vortex-compact 300012545 292708210 1.02
tpch_q16/duckdb:vortex-compact 337707784 331938115 1.02
tpch_q17/duckdb:vortex-compact 804464847 666830721 1.21
tpch_q18/duckdb:vortex-compact 517994253 556356639 0.93
tpch_q19/duckdb:vortex-compact 473273274 464696905 1.02
tpch_q20/duckdb:vortex-compact 694207509 707215938 0.98
tpch_q21/duckdb:vortex-compact 977449899 988663300 0.99
tpch_q22/duckdb:vortex-compact 279952830 299335849 0.94
duckdb / parquet (1.033x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 466774501 446268847 1.05
tpch_q02/duckdb:parquet 1101095475 1104314855 1.00
tpch_q03/duckdb:parquet 1132270971 975135911 1.16
tpch_q04/duckdb:parquet 651777380 652141960 1.00
tpch_q05/duckdb:parquet 1179175135 1273265609 0.93
tpch_q06/duckdb:parquet 438432413 450995365 0.97
tpch_q07/duckdb:parquet 1297037401 1292039137 1.00
tpch_q08/duckdb:parquet 1568414501 1515178628 1.04
tpch_q09/duckdb:parquet 1442027073 1380282699 1.04
tpch_q10/duckdb:parquet 1257554153 1294054413 0.97
tpch_q11/duckdb:parquet 805339469 706116097 1.14
tpch_q12/duckdb:parquet 766176318 768816871 1.00
tpch_q13/duckdb:parquet 940414414 931115900 1.01
tpch_q14/duckdb:parquet 821019877 735896337 1.12
tpch_q15/duckdb:parquet 674820461 614747723 1.10
tpch_q16/duckdb:parquet 698922705 649607265 1.08
tpch_q17/duckdb:parquet 892713395 844819999 1.06
tpch_q18/duckdb:parquet 916348431 989074067 0.93
tpch_q19/duckdb:parquet 846950986 781973243 1.08
tpch_q20/duckdb:parquet 1214505585 1216640729 1.00
tpch_q21/duckdb:parquet 1162746703 1137434136 1.02
tpch_q22/duckdb:parquet 656026540 607349128 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -22.3% +0.1% -22.3% +91.4% ➖ noise
1 datafusion:vortex-file-compressed +8.2% +0.1% +8.1% +63.7% ➖ noise
1 duckdb:vortex-compact +16.5% +0.1% +16.4% +42.7% ➖ noise
1 duckdb:vortex-file-compressed -8.2% +0.1% -8.3% +43.2% ➖ noise
2 datafusion:vortex-compact -2.8% +8.8% -10.7% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -6.4% +8.8% -14.0% +30.0% ➖ noise
2 duckdb:vortex-compact -7.3% +8.8% -14.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +0.5% +8.8% -7.6% +30.0% ➖ noise
3 datafusion:vortex-compact -6.5% +27.1% -26.4% +41.2% ➖ noise
3 datafusion:vortex-file-compressed +0.5% +27.1% -20.9% +49.6% ➖ noise
3 duckdb:vortex-compact +8.8% +27.1% -14.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -7.7% +27.1% -27.3% +40.8% ➖ noise
4 datafusion:vortex-compact -13.1% +16.0% -25.1% +41.4% ➖ noise
4 datafusion:vortex-file-compressed -8.4% +16.0% -21.0% +30.0% ➖ noise
4 duckdb:vortex-compact -4.0% +16.0% -17.2% +32.1% ➖ noise
4 duckdb:vortex-file-compressed +0.9% +16.0% -13.0% +35.3% ➖ noise
5 datafusion:vortex-compact -3.8% -14.6% +12.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.4% -14.6% +13.1% +30.0% ➖ noise
5 duckdb:vortex-compact -3.4% -14.6% +13.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -7.9% -14.6% +7.9% +30.0% ➖ noise
6 datafusion:vortex-compact -17.5% +3.2% -20.1% +30.1% ➖ noise
6 datafusion:vortex-file-compressed +0.5% +3.2% -2.6% +32.5% ➖ noise
6 duckdb:vortex-compact +24.2% +3.2% +20.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -21.4% +3.2% -23.8% +32.2% ➖ noise
7 datafusion:vortex-compact -2.0% +0.1% -2.0% +35.9% ➖ noise
7 datafusion:vortex-file-compressed +15.3% +0.1% +15.2% +30.0% ➖ noise
7 duckdb:vortex-compact -8.4% +0.1% -8.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +13.6% +0.1% +13.6% +30.0% ➖ noise
8 datafusion:vortex-compact -14.6% +1.0% -15.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +13.9% +1.0% +12.8% +30.0% ➖ noise
8 duckdb:vortex-compact -7.7% +1.0% -8.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +5.2% +1.0% +4.1% +30.0% ➖ noise
9 datafusion:vortex-compact -10.0% +14.6% -21.4% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +40.1% +14.6% +22.3% +30.0% ➖ noise
9 duckdb:vortex-compact -7.4% +14.6% -19.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +21.1% +14.6% +5.7% +30.0% ➖ noise
10 datafusion:vortex-compact -13.3% +14.6% -24.4% +30.0% ✅ faster
10 datafusion:vortex-file-compressed +29.2% +14.6% +12.7% +30.3% ➖ noise
10 duckdb:vortex-compact -9.6% +14.6% -21.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +3.9% +14.6% -9.4% +30.0% ➖ noise
11 datafusion:vortex-compact -9.5% +1.0% -10.4% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +11.7% +1.0% +10.6% +30.0% ➖ noise
11 duckdb:vortex-compact -9.9% +1.0% -10.8% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +17.8% +1.0% +16.6% +30.0% ➖ noise
12 datafusion:vortex-compact -22.2% +13.9% -31.7% +37.7% ✅ faster
12 datafusion:vortex-file-compressed +15.2% +13.9% +1.2% +30.0% ➖ noise
12 duckdb:vortex-compact +17.2% +13.9% +2.9% +37.6% ➖ noise
12 duckdb:vortex-file-compressed +12.7% +13.9% -1.0% +30.0% ➖ noise
13 datafusion:vortex-compact -34.5% +5.4% -37.8% +67.6% ➖ noise
13 datafusion:vortex-file-compressed -14.2% +5.4% -18.6% +36.2% ➖ noise
13 duckdb:vortex-compact -2.9% +5.4% -7.9% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -5.1% +5.4% -10.0% +44.1% ➖ noise
14 datafusion:vortex-compact -25.1% +22.4% -38.8% +30.0% ✅ faster
14 datafusion:vortex-file-compressed +52.4% +22.4% +24.5% +39.1% ➖ noise
14 duckdb:vortex-compact +2.1% +22.4% -16.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +4.0% +22.4% -15.1% +37.1% ➖ noise
15 datafusion:vortex-compact +2.8% +11.9% -8.2% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +10.6% +11.9% -1.2% +36.1% ➖ noise
15 duckdb:vortex-compact +2.5% +11.9% -8.4% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +11.2% +11.9% -0.6% +30.0% ➖ noise
16 datafusion:vortex-compact -11.6% +3.6% -14.7% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +36.5% +3.6% +31.7% +45.8% ➖ noise
16 duckdb:vortex-compact +1.7% +3.6% -1.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +16.3% +3.6% +12.2% +30.0% ➖ noise
17 datafusion:vortex-compact -33.7% +11.4% -40.5% +30.0% ✅ faster
17 datafusion:vortex-file-compressed +5.1% +11.4% -5.6% +30.0% ➖ noise
17 duckdb:vortex-compact +20.6% +11.4% +8.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -2.2% +11.4% -12.2% +32.4% ➖ noise
18 datafusion:vortex-compact -34.5% -3.9% -31.9% +30.0% ✅ faster
18 datafusion:vortex-file-compressed +11.9% -3.9% +16.4% +30.0% ➖ noise
18 duckdb:vortex-compact -6.9% -3.9% -3.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +20.1% -3.9% +24.9% +30.0% ➖ noise
19 datafusion:vortex-compact -20.0% +0.5% -20.4% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -6.7% +0.5% -7.2% +30.0% ➖ noise
19 duckdb:vortex-compact +1.8% +0.5% +1.4% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -10.3% +0.5% -10.8% +30.0% ➖ noise
20 datafusion:vortex-compact +1.4% +2.1% -0.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +1.0% +2.1% -1.1% +30.0% ➖ noise
20 duckdb:vortex-compact -1.8% +2.1% -3.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +1.2% +2.1% -0.9% +30.0% ➖ noise
21 datafusion:vortex-compact +1.1% +1.2% -0.1% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +4.0% +1.2% +2.8% +30.0% ➖ noise
21 duckdb:vortex-compact -1.1% +1.2% -2.3% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +6.3% +1.2% +5.0% +30.0% ➖ noise
22 datafusion:vortex-compact +9.5% +4.9% +4.4% +60.0% ➖ noise
22 datafusion:vortex-file-compressed -36.3% +4.9% -39.3% +51.1% ✅ faster
22 duckdb:vortex-compact -6.5% +4.9% -10.9% +31.8% ➖ noise
22 duckdb:vortex-file-compressed -14.7% +4.9% -18.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: Compression

Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.008x ➖

unknown / unknown (1.011x ➖, 1↑ 7↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
compress time/Arade 1152445922 1141405765 1.01
compress time/Bimbo 6792805778 7018097141 0.97
compress time/CMSprovider 2830455778 2860016214 0.99
compress time/Euro2016 435995728 423040233 1.03
compress time/Food 410434556 376531854 1.09
compress time/HashTags 812080843 814784405 1.00
compress time/TPC-H l_comment canonical 1296905924 1277376937 1.02
compress time/TPC-H l_comment chunked 1302120959 1271710601 1.02
compress time/taxi 718982064 727473223 0.99
compress time/wide table cols=100 chunks=1 rows=1000 11503951 12322310 0.93
compress time/wide table cols=100 chunks=50 rows=1000 12391284 11554376 1.07
compress time/wide table cols=1000 chunks=1 rows=1000 124608700 128647407 0.97
compress time/wide table cols=1000 chunks=50 rows=1000 🚨 141140518 123595149 1.14
compress time/wide table cols=10000 chunks=1 rows=1000 1412444027 1433358599 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1444130573 1397303581 1.03
decompress time/Arade 24963893 27578955 0.91
decompress time/Bimbo 77090784 78835998 0.98
decompress time/CMSprovider 77179757 77721113 0.99
decompress time/Euro2016 18626784 18411955 1.01
decompress time/Food 🚨 10130983 7823263 1.29
decompress time/HashTags 70280828 73435134 0.96
decompress time/TPC-H l_comment canonical 40655586 40557361 1.00
decompress time/TPC-H l_comment chunked 39389106 39620167 0.99
decompress time/taxi 14713682 14488644 1.02
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2621454 2341704 1.12
decompress time/wide table cols=100 chunks=50 rows=1000 2683505 2527643 1.06
decompress time/wide table cols=1000 chunks=1 rows=1000 22729112 21908880 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 27471940 22434431 1.22
decompress time/wide table cols=10000 chunks=1 rows=1000 243514413 250584694 0.97
decompress time/wide table cols=10000 chunks=50 rows=1000 248332459 241698791 1.03
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2608257940 2612287776 1.00
parquet_rs-zstd compress time/Bimbo 12555933555 12777964126 0.98
parquet_rs-zstd compress time/CMSprovider 6821600535 6840083210 1.00
parquet_rs-zstd compress time/Euro2016 1287929001 1305860843 0.99
parquet_rs-zstd compress time/Food 824317815 801685573 1.03
parquet_rs-zstd compress time/HashTags 2126106796 2153116616 0.99
parquet_rs-zstd compress time/TPC-H l_comment canonical 3203916630 3176508438 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked 3162335832 3179832598 0.99
parquet_rs-zstd compress time/taxi 1226201652 1197986541 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6552879 5974883 1.10
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6465705 6079936 1.06
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 76331576 73424673 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 79443265 75097106 1.06
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 843415704 772707864 1.09
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 764501867 773378223 0.99
parquet_rs-zstd decompress time/Arade 615292966 614644799 1.00
parquet_rs-zstd decompress time/Bimbo 1679721548 1698579839 0.99
parquet_rs-zstd decompress time/CMSprovider 1713325985 1700070819 1.01
parquet_rs-zstd decompress time/Euro2016 369928010 371177746 1.00
parquet_rs-zstd decompress time/Food 211212109 198600027 1.06
parquet_rs-zstd decompress time/HashTags 621722387 621822092 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 588286946 592913239 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 588267173 589670464 1.00
parquet_rs-zstd decompress time/taxi 244856919 243060276 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2777051 2789151 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2821463 2817910 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33014007 31860652 1.04
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 36170187 33239520 1.09
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 340345037 344258905 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 340233310 344239610 0.99
vortex-file-compressed size/Arade 145363796 145363828 1.00
vortex-file-compressed size/Bimbo 468763332 468763364 1.00
vortex-file-compressed size/CMSprovider 417907812 417907844 1.00
vortex-file-compressed size/Euro2016 163394924 163395324 1.00
vortex-file-compressed size/Food 41926936 41926968 1.00
vortex-file-compressed size/HashTags 195647828 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087392 1.00
vortex-file-compressed size/taxi 52363948 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio compress time/Food 0 0 1.06
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 0 0 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 2 0.85
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.90
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.90
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.22
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.6%
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish -1.8%

datafusion / vortex-file-compressed (0.941x ➖, 1↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 820083064 722730015 1.13
tpch_q02/datafusion:vortex-file-compressed 863204924 767079534 1.13
tpch_q03/datafusion:vortex-file-compressed 851848356 1082286782 0.79
tpch_q04/datafusion:vortex-file-compressed 580778592 628784582 0.92
tpch_q05/datafusion:vortex-file-compressed 917028456 1002100474 0.92
tpch_q06/datafusion:vortex-file-compressed 568838837 595579744 0.96
tpch_q07/datafusion:vortex-file-compressed 986264977 989953725 1.00
tpch_q08/datafusion:vortex-file-compressed 1186865357 1198158906 0.99
tpch_q09/datafusion:vortex-file-compressed 1532279833 1299839713 1.18
tpch_q10/datafusion:vortex-file-compressed 970612963 866157266 1.12
tpch_q11/datafusion:vortex-file-compressed 500568716 508850751 0.98
tpch_q12/datafusion:vortex-file-compressed 850933149 916142094 0.93
tpch_q13/datafusion:vortex-file-compressed 493616984 423393761 1.17
tpch_q14/datafusion:vortex-file-compressed 538549623 543299668 0.99
tpch_q15/datafusion:vortex-file-compressed 938528688 969572724 0.97
tpch_q16/datafusion:vortex-file-compressed 🚀 334682537 600304189 0.56
tpch_q17/datafusion:vortex-file-compressed 1175678436 1566134638 0.75
tpch_q18/datafusion:vortex-file-compressed 1219399685 1480417273 0.82
tpch_q19/datafusion:vortex-file-compressed 758059888 865236286 0.88
tpch_q20/datafusion:vortex-file-compressed 925699047 875535459 1.06
tpch_q21/datafusion:vortex-file-compressed 1614919366 1703168505 0.95
tpch_q22/datafusion:vortex-file-compressed 348549393 435707590 0.80
datafusion / vortex-compact (0.963x ➖, 2↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 687229673 710379531 0.97
tpch_q02/datafusion:vortex-compact 617487810 848109476 0.73
tpch_q03/datafusion:vortex-compact 🚀 653242928 936202294 0.70
tpch_q04/datafusion:vortex-compact 494760366 544822882 0.91
tpch_q05/datafusion:vortex-compact 823915146 915429687 0.90
tpch_q06/datafusion:vortex-compact 469773761 588048613 0.80
tpch_q07/datafusion:vortex-compact 951708823 1092523308 0.87
tpch_q08/datafusion:vortex-compact 1100165461 1128992583 0.97
tpch_q09/datafusion:vortex-compact 1449342716 1227840927 1.18
tpch_q10/datafusion:vortex-compact 1130474343 871334870 1.30
tpch_q11/datafusion:vortex-compact 409971595 397464422 1.03
tpch_q12/datafusion:vortex-compact 🚨 1223501070 808010471 1.51
tpch_q13/datafusion:vortex-compact 425782365 392378183 1.09
tpch_q14/datafusion:vortex-compact 563585402 529668163 1.06
tpch_q15/datafusion:vortex-compact 904889586 942704794 0.96
tpch_q16/datafusion:vortex-compact 400004198 319653531 1.25
tpch_q17/datafusion:vortex-compact 1193960572 1290799336 0.92
tpch_q18/datafusion:vortex-compact 🚀 1092133172 1785703262 0.61
tpch_q19/datafusion:vortex-compact 781888126 828128303 0.94
tpch_q20/datafusion:vortex-compact 784485343 751402496 1.04
tpch_q21/datafusion:vortex-compact 1399970554 1504317900 0.93
tpch_q22/datafusion:vortex-compact 363049020 394356171 0.92
datafusion / parquet (1.000x ➖, 0↑ 1↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 964200734 850339211 1.13
tpch_q02/datafusion:parquet 1127156644 887185577 1.27
tpch_q03/datafusion:parquet 948411056 1037482887 0.91
tpch_q04/datafusion:parquet 514863257 503182585 1.02
tpch_q05/datafusion:parquet 1163403329 1270456948 0.92
tpch_q06/datafusion:parquet 549053689 650573677 0.84
tpch_q07/datafusion:parquet 1392049887 1298567312 1.07
tpch_q08/datafusion:parquet 1599149729 1799894579 0.89
tpch_q09/datafusion:parquet 1823276331 1949254718 0.94
tpch_q10/datafusion:parquet 1941477358 1952393946 0.99
tpch_q11/datafusion:parquet 455674025 499247002 0.91
tpch_q12/datafusion:parquet 615782958 745222089 0.83
tpch_q13/datafusion:parquet 709039050 739504134 0.96
tpch_q14/datafusion:parquet 739958800 832742483 0.89
tpch_q15/datafusion:parquet 1224832304 1255621829 0.98
tpch_q16/datafusion:parquet 376167761 340204938 1.11
tpch_q17/datafusion:parquet 1350921263 1297944628 1.04
tpch_q18/datafusion:parquet 1423396381 1508668492 0.94
tpch_q19/datafusion:parquet 898613107 986762958 0.91
tpch_q20/datafusion:parquet 1239112624 1330630060 0.93
tpch_q21/datafusion:parquet 1931763434 1867609604 1.03
tpch_q22/datafusion:parquet 🚨 1216318057 672748347 1.81
duckdb / vortex-file-compressed (1.067x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 617681977 645171398 0.96
tpch_q02/duckdb:vortex-file-compressed 1172483095 1125841417 1.04
tpch_q03/duckdb:vortex-file-compressed 1107301225 905622148 1.22
tpch_q04/duckdb:vortex-file-compressed 804211937 745785530 1.08
tpch_q05/duckdb:vortex-file-compressed 1261750430 1191441142 1.06
tpch_q06/duckdb:vortex-file-compressed 561989042 551217229 1.02
tpch_q07/duckdb:vortex-file-compressed 1370909634 1297652581 1.06
tpch_q08/duckdb:vortex-file-compressed 1579414815 1407327850 1.12
tpch_q09/duckdb:vortex-file-compressed 1958762275 1818431855 1.08
tpch_q10/duckdb:vortex-file-compressed 1264413833 1216534563 1.04
tpch_q11/duckdb:vortex-file-compressed 686125470 663922190 1.03
tpch_q12/duckdb:vortex-file-compressed 1329099484 1243388556 1.07
tpch_q13/duckdb:vortex-file-compressed 1169903022 969179175 1.21
tpch_q14/duckdb:vortex-file-compressed 702121436 697558729 1.01
tpch_q15/duckdb:vortex-file-compressed 575759173 569777807 1.01
tpch_q16/duckdb:vortex-file-compressed 493509081 476223977 1.04
tpch_q17/duckdb:vortex-file-compressed 1022246213 1114722360 0.92
tpch_q18/duckdb:vortex-file-compressed 1031230173 918960433 1.12
tpch_q19/duckdb:vortex-file-compressed 825776472 765818087 1.08
tpch_q20/duckdb:vortex-file-compressed 1353438641 1189352825 1.14
tpch_q21/duckdb:vortex-file-compressed 2182335180 1896583369 1.15
tpch_q22/duckdb:vortex-file-compressed 459915344 425885987 1.08
duckdb / vortex-compact (1.141x ➖, 0↑ 2↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 624001575 578389051 1.08
tpch_q02/duckdb:vortex-compact 🚨 1377092224 1042987357 1.32
tpch_q03/duckdb:vortex-compact 859445985 789570547 1.09
tpch_q04/duckdb:vortex-compact 745265943 585635503 1.27
tpch_q05/duckdb:vortex-compact 1268877362 1058291417 1.20
tpch_q06/duckdb:vortex-compact 576257490 532989029 1.08
tpch_q07/duckdb:vortex-compact 1178019909 1159159213 1.02
tpch_q08/duckdb:vortex-compact 1440986129 1335482336 1.08
tpch_q09/duckdb:vortex-compact 1901248945 1527767717 1.24
tpch_q10/duckdb:vortex-compact 1411299594 1211731083 1.16
tpch_q11/duckdb:vortex-compact 764229178 680977751 1.12
tpch_q12/duckdb:vortex-compact 1111262326 1033891042 1.07
tpch_q13/duckdb:vortex-compact 1026118242 856193572 1.20
tpch_q14/duckdb:vortex-compact 679014783 598772692 1.13
tpch_q15/duckdb:vortex-compact 600943423 534775919 1.12
tpch_q16/duckdb:vortex-compact 392972266 439051453 0.90
tpch_q17/duckdb:vortex-compact 1007591572 908353798 1.11
tpch_q18/duckdb:vortex-compact 826822105 810994841 1.02
tpch_q19/duckdb:vortex-compact 818539271 700387774 1.17
tpch_q20/duckdb:vortex-compact 1281928846 1038754189 1.23
tpch_q21/duckdb:vortex-compact 2102678925 1646687965 1.28
tpch_q22/duckdb:vortex-compact 🚨 537939036 411562154 1.31
duckdb / parquet (1.017x ➖, 0↑ 0↓)
name PR a8ddbfe (ns) base dba7935 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 830020472 794447452 1.04
tpch_q02/duckdb:parquet 1348342147 1372453577 0.98
tpch_q03/duckdb:parquet 1656157478 1847649804 0.90
tpch_q04/duckdb:parquet 1011958043 1178141904 0.86
tpch_q05/duckdb:parquet 1882003971 1969737073 0.96
tpch_q06/duckdb:parquet 743572911 731213602 1.02
tpch_q07/duckdb:parquet 1783161476 2089172611 0.85
tpch_q08/duckdb:parquet 2371699185 2478789660 0.96
tpch_q09/duckdb:parquet 2380672610 2763376266 0.86
tpch_q10/duckdb:parquet 3142000281 3089377053 1.02
tpch_q11/duckdb:parquet 969165132 1011754777 0.96
tpch_q12/duckdb:parquet 1350519899 1112575151 1.21
tpch_q13/duckdb:parquet 1333857651 1203646519 1.11
tpch_q14/duckdb:parquet 1307068608 1263923716 1.03
tpch_q15/duckdb:parquet 1096585347 907568157 1.21
tpch_q16/duckdb:parquet 918644890 937533587 0.98
tpch_q17/duckdb:parquet 1363167019 1303933051 1.05
tpch_q18/duckdb:parquet 1788005710 1596974149 1.12
tpch_q19/duckdb:parquet 1678156443 1494853648 1.12
tpch_q20/duckdb:parquet 2136568128 1953536507 1.09
tpch_q21/duckdb:parquet 2041228366 1795369504 1.14
tpch_q22/duckdb:parquet 1177656944 1156013289 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.3% +8.8% -11.1% +34.7% ➖ noise
1 datafusion:vortex-file-compressed +13.5% +8.8% +4.3% +68.9% ➖ noise
1 duckdb:vortex-compact +7.9% +8.8% -0.9% +35.8% ➖ noise
1 duckdb:vortex-file-compressed -4.3% +8.8% -12.0% +61.1% ➖ noise
2 datafusion:vortex-compact -27.2% +11.7% -34.8% +31.9% ✅ faster
2 datafusion:vortex-file-compressed +12.5% +11.7% +0.7% +34.0% ➖ noise
2 duckdb:vortex-compact +32.0% +11.7% +18.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +4.1% +11.7% -6.8% +30.0% ➖ noise
3 datafusion:vortex-compact -30.2% -9.5% -22.9% +39.4% ➖ noise
3 datafusion:vortex-file-compressed -21.3% -9.5% -13.0% +43.8% ➖ noise
3 duckdb:vortex-compact +8.8% -9.5% +20.2% +33.5% ➖ noise
3 duckdb:vortex-file-compressed +22.3% -9.5% +35.1% +32.6% 🚨 regression
4 datafusion:vortex-compact -9.2% -6.3% -3.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -7.6% -6.3% -1.5% +30.0% ➖ noise
4 duckdb:vortex-compact +27.3% -6.3% +35.7% +30.0% 🚨 regression
4 duckdb:vortex-file-compressed +7.8% -6.3% +15.0% +30.0% ➖ noise
5 datafusion:vortex-compact -10.0% -6.5% -3.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -8.5% -6.5% -2.2% +30.0% ➖ noise
5 duckdb:vortex-compact +19.9% -6.5% +28.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +5.9% -6.5% +13.2% +30.0% ➖ noise
6 datafusion:vortex-compact -20.1% -7.4% -13.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -4.5% -7.4% +3.1% +30.0% ➖ noise
6 duckdb:vortex-compact +8.1% -7.4% +16.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.0% -7.4% +10.1% +30.0% ➖ noise
7 datafusion:vortex-compact -12.9% -4.3% -8.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.4% -4.3% +4.2% +30.0% ➖ noise
7 duckdb:vortex-compact +1.6% -4.3% +6.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.6% -4.3% +10.4% +30.0% ➖ noise
8 datafusion:vortex-compact -2.6% -7.8% +5.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -0.9% -7.8% +7.4% +30.0% ➖ noise
8 duckdb:vortex-compact +7.9% -7.8% +17.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +12.2% -7.8% +21.7% +30.0% ➖ noise
9 datafusion:vortex-compact +18.0% -10.2% +31.5% +30.0% 🚨 regression
9 datafusion:vortex-file-compressed +17.9% -10.2% +31.3% +30.0% 🚨 regression
9 duckdb:vortex-compact +24.4% -10.2% +38.6% +30.0% 🚨 regression
9 duckdb:vortex-file-compressed +7.7% -10.2% +20.0% +30.0% ➖ noise
10 datafusion:vortex-compact +29.7% +0.6% +29.0% +33.8% ➖ noise
10 datafusion:vortex-file-compressed +12.1% +0.6% +11.4% +30.0% ➖ noise
10 duckdb:vortex-compact +16.5% +0.6% +15.8% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +3.9% +0.6% +3.4% +30.0% ➖ noise
11 datafusion:vortex-compact +3.1% -6.5% +10.3% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -1.6% -6.5% +5.2% +30.0% ➖ noise
11 duckdb:vortex-compact +12.2% -6.5% +20.0% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +3.3% -6.5% +10.5% +30.0% ➖ noise
12 datafusion:vortex-compact +51.4% +0.2% +51.2% +30.0% 🚨 regression
12 datafusion:vortex-file-compressed -7.1% +0.2% -7.3% +30.0% ➖ noise
12 duckdb:vortex-compact +7.5% +0.2% +7.3% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +6.9% +0.2% +6.7% +30.0% ➖ noise
13 datafusion:vortex-compact +8.5% +3.1% +5.3% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +16.6% +3.1% +13.1% +30.0% ➖ noise
13 duckdb:vortex-compact +19.8% +3.1% +16.3% +39.0% ➖ noise
13 duckdb:vortex-file-compressed +20.7% +3.1% +17.1% +41.9% ➖ noise
14 datafusion:vortex-compact +6.4% -4.1% +11.0% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -0.9% -4.1% +3.4% +30.0% ➖ noise
14 duckdb:vortex-compact +13.4% -4.1% +18.3% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +0.7% -4.1% +5.0% +30.0% ➖ noise
15 datafusion:vortex-compact -4.0% +8.6% -11.6% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -3.2% +8.6% -10.8% +30.0% ➖ noise
15 duckdb:vortex-compact +12.4% +8.6% +3.5% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +1.0% +8.6% -6.9% +30.0% ➖ noise
16 datafusion:vortex-compact +25.1% +4.1% +20.2% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -44.2% +4.1% -46.4% +35.1% ✅ faster
16 duckdb:vortex-compact -10.5% +4.1% -14.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +3.6% +4.1% -0.4% +30.0% ➖ noise
17 datafusion:vortex-compact -7.5% +4.3% -11.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -24.9% +4.3% -28.0% +30.0% ✅ faster
17 duckdb:vortex-compact +10.9% +4.3% +6.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -8.3% +4.3% -12.1% +30.0% ➖ noise
18 datafusion:vortex-compact -38.8% +2.8% -40.5% +30.0% ✅ faster
18 datafusion:vortex-file-compressed -17.6% +2.8% -19.9% +30.0% ➖ noise
18 duckdb:vortex-compact +2.0% +2.8% -0.8% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +12.2% +2.8% +9.2% +30.0% ➖ noise
19 datafusion:vortex-compact -5.6% +1.1% -6.6% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -12.4% +1.1% -13.3% +30.0% ➖ noise
19 duckdb:vortex-compact +16.9% +1.1% +15.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +7.8% +1.1% +6.6% +30.0% ➖ noise
20 datafusion:vortex-compact +4.4% +0.9% +3.5% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +5.7% +0.9% +4.8% +30.0% ➖ noise
20 duckdb:vortex-compact +23.4% +0.9% +22.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +13.8% +0.9% +12.8% +30.0% ➖ noise
21 datafusion:vortex-compact -6.9% +8.4% -14.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -5.2% +8.4% -12.6% +30.0% ➖ noise
21 duckdb:vortex-compact +27.7% +8.4% +17.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +15.1% +8.4% +6.1% +30.0% ➖ noise
22 datafusion:vortex-compact -7.9% +35.7% -32.2% +30.0% ✅ faster
22 datafusion:vortex-file-compressed -20.0% +35.7% -41.1% +30.0% ✅ faster
22 duckdb:vortex-compact +30.7% +35.7% -3.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +8.0% +35.7% -20.4% +30.0% ➖ noise

@robert3005 robert3005 requested a review from onursatici May 22, 2026 12:49
joseph-isaacs and others added 9 commits May 22, 2026 14:32
@joseph-isaacs @robert3005
perf[array]: bool filter kernel optimisation
06625a7 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@robert3005
locks
7c8cb9d 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
simpler
dd19969 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
refactor
3a51ad7 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
format
b1caeca 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
imports
fa1b58e 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
more
ce6480f 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
more
4711709 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
fixes
af0ee1e 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 force-pushed the ji/bool-filter-optimized branch from 926a88a to af0ee1e Compare May 22, 2026 13:32
@tl-dr-review tl-dr-review Bot added tldr and removed tldr labels May 22, 2026
onursatici
onursatici reviewed May 22, 2026
View reviewed changes
Comment thread vortex-array/src/arrays/bool/compute/filter.rs Outdated
Comment thread vortex-array/src/arrays/filter/execute/byte_compress.rs Outdated
Comment thread vortex-array/src/arrays/bool/compute/filter.rs
@robert3005
more
afac7dd 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Copy link
Copy Markdown
Contributor

robert3005 commented May 22, 2026

I have added handling for non 0 offsets for byte_compress method

@robert3005 robert3005 enabled auto-merge (squash) May 22, 2026 15:09
@robert3005 robert3005 merged commit c275f2c into develop May 22, 2026
66 checks passed
@robert3005 robert3005 deleted the ji/bool-filter-optimized branch May 22, 2026 15:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 left review comments

@onursatici onursatici onursatici approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement tldr

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@joseph-isaacs @robert3005 @onursatici